2023-07-12 18:14:05,286 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 18:14:05,551 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18 2023-07-12 18:14:05,551 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-12 18:14:05,595 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 18:14:05,879 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 18:14:05,879 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb, deleteOnExit=true 2023-07-12 18:14:05,880 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 18:14:05,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/test.cache.data in system properties and HBase conf 2023-07-12 18:14:05,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 18:14:05,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop.log.dir in system properties and HBase conf 2023-07-12 18:14:05,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 18:14:05,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 18:14:05,882 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 18:14:06,347 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 18:14:06,354 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:06,354 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:06,355 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 18:14:06,355 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:06,356 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 18:14:06,356 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 18:14:06,356 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:06,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:06,357 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 18:14:06,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/nfs.dump.dir in system properties and HBase conf 2023-07-12 18:14:06,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir in system properties and HBase conf 2023-07-12 18:14:06,358 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:06,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 18:14:06,359 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 18:14:07,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:14:07,048 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:14:07,434 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 18:14:07,703 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 18:14:07,724 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:07,771 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:07,816 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_localhost_37109_hdfs____.lax0lc/webapp 2023-07-12 18:14:07,998 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37109 2023-07-12 18:14:08,040 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 18:14:08,040 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 18:14:08,564 WARN [Listener at localhost/43721] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:08,673 WARN [Listener at localhost/43721] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:14:08,701 WARN [Listener at localhost/43721] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:08,710 INFO [Listener at localhost/43721] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:08,718 INFO [Listener at localhost/43721] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_localhost_37417_datanode____.axyx7n/webapp 2023-07-12 18:14:08,900 INFO [Listener at localhost/43721] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37417 2023-07-12 18:14:09,512 WARN [Listener at localhost/43425] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:09,559 WARN [Listener at localhost/43425] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:14:09,566 WARN [Listener at localhost/43425] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:09,569 INFO [Listener at localhost/43425] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:09,580 INFO [Listener at localhost/43425] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_localhost_46023_datanode____28c7iu/webapp 2023-07-12 18:14:09,718 INFO [Listener at localhost/43425] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46023 2023-07-12 18:14:09,761 WARN [Listener at localhost/45067] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:09,795 WARN [Listener at localhost/45067] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 18:14:09,799 WARN [Listener at localhost/45067] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:09,801 INFO [Listener at localhost/45067] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:09,816 INFO [Listener at localhost/45067] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_localhost_34869_datanode____.8fbti7/webapp 2023-07-12 18:14:09,980 INFO [Listener at localhost/45067] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34869 2023-07-12 18:14:10,008 WARN [Listener at localhost/43601] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 18:14:10,291 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xafcd4d9afdb3f5c7: Processing first storage report for DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c from datanode d11e8186-caeb-4f53-83a8-282490990970 2023-07-12 18:14:10,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xafcd4d9afdb3f5c7: from storage DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c node DatanodeRegistration(127.0.0.1:41285, datanodeUuid=d11e8186-caeb-4f53-83a8-282490990970, infoPort=34831, infoSecurePort=0, ipcPort=43601, storageInfo=lv=-57;cid=testClusterID;nsid=923736982;c=1689185647144), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbb759fa280a20e96: Processing first storage report for DS-a0a8375d-18df-49ec-a60a-04e217ae76fd from datanode 51da195b-f8b8-4808-9241-188c332d1ba8 2023-07-12 18:14:10,293 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbb759fa280a20e96: from storage DS-a0a8375d-18df-49ec-a60a-04e217ae76fd node DatanodeRegistration(127.0.0.1:43957, datanodeUuid=51da195b-f8b8-4808-9241-188c332d1ba8, infoPort=43631, infoSecurePort=0, ipcPort=43425, storageInfo=lv=-57;cid=testClusterID;nsid=923736982;c=1689185647144), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,293 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x97eb3c8705ae9109: Processing first storage report for DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1 from datanode 2a3be9cf-285f-4a59-9f46-1f636f0c6f40 2023-07-12 18:14:10,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x97eb3c8705ae9109: from storage DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1 node DatanodeRegistration(127.0.0.1:35669, datanodeUuid=2a3be9cf-285f-4a59-9f46-1f636f0c6f40, infoPort=45563, infoSecurePort=0, ipcPort=45067, storageInfo=lv=-57;cid=testClusterID;nsid=923736982;c=1689185647144), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xafcd4d9afdb3f5c7: Processing first storage report for DS-2f7d674a-1d2d-4c1b-b59c-398ed39e153b from datanode d11e8186-caeb-4f53-83a8-282490990970 2023-07-12 18:14:10,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xafcd4d9afdb3f5c7: from storage DS-2f7d674a-1d2d-4c1b-b59c-398ed39e153b node DatanodeRegistration(127.0.0.1:41285, datanodeUuid=d11e8186-caeb-4f53-83a8-282490990970, infoPort=34831, infoSecurePort=0, ipcPort=43601, storageInfo=lv=-57;cid=testClusterID;nsid=923736982;c=1689185647144), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xbb759fa280a20e96: Processing first storage report for DS-601dd895-980d-4a70-ad43-09f9ed611f07 from datanode 51da195b-f8b8-4808-9241-188c332d1ba8 2023-07-12 18:14:10,294 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xbb759fa280a20e96: from storage DS-601dd895-980d-4a70-ad43-09f9ed611f07 node DatanodeRegistration(127.0.0.1:43957, datanodeUuid=51da195b-f8b8-4808-9241-188c332d1ba8, infoPort=43631, infoSecurePort=0, ipcPort=43425, storageInfo=lv=-57;cid=testClusterID;nsid=923736982;c=1689185647144), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,294 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x97eb3c8705ae9109: Processing first storage report for DS-026cdc60-556f-402e-af00-df4db01711b4 from datanode 2a3be9cf-285f-4a59-9f46-1f636f0c6f40 2023-07-12 18:14:10,305 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x97eb3c8705ae9109: from storage DS-026cdc60-556f-402e-af00-df4db01711b4 node DatanodeRegistration(127.0.0.1:35669, datanodeUuid=2a3be9cf-285f-4a59-9f46-1f636f0c6f40, infoPort=45563, infoSecurePort=0, ipcPort=45067, storageInfo=lv=-57;cid=testClusterID;nsid=923736982;c=1689185647144), blocks: 0, hasStaleStorage: false, processing time: 11 msecs, invalidatedBlocks: 0 2023-07-12 18:14:10,599 DEBUG [Listener at localhost/43601] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18 2023-07-12 18:14:10,693 INFO [Listener at localhost/43601] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/zookeeper_0, clientPort=61297, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 18:14:10,719 INFO [Listener at localhost/43601] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=61297 2023-07-12 18:14:10,730 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:10,733 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:11,432 INFO [Listener at localhost/43601] util.FSUtils(471): Created version file at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a with version=8 2023-07-12 18:14:11,432 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/hbase-staging 2023-07-12 18:14:11,814 INFO [Listener at localhost/43601] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 18:14:12,413 INFO [Listener at localhost/43601] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:12,446 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:12,447 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:12,447 INFO [Listener at localhost/43601] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:12,447 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:12,447 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:12,615 INFO [Listener at localhost/43601] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:12,690 DEBUG [Listener at localhost/43601] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 18:14:12,812 INFO [Listener at localhost/43601] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33521 2023-07-12 18:14:12,829 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:12,832 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:12,860 INFO [Listener at localhost/43601] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33521 connecting to ZooKeeper ensemble=127.0.0.1:61297 2023-07-12 18:14:12,949 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:335210x0, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:12,964 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33521-0x1015abe0af20000 connected 2023-07-12 18:14:13,018 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,019 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,034 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,046 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33521 2023-07-12 18:14:13,046 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33521 2023-07-12 18:14:13,047 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33521 2023-07-12 18:14:13,050 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33521 2023-07-12 18:14:13,054 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33521 2023-07-12 18:14:13,062 INFO [Listener at localhost/43601] master.HMaster(444): hbase.rootdir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, hbase.cluster.distributed=false 2023-07-12 18:14:13,146 INFO [Listener at localhost/43601] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:13,146 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,147 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,147 INFO [Listener at localhost/43601] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:13,147 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,147 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:13,152 INFO [Listener at localhost/43601] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:13,155 INFO [Listener at localhost/43601] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41341 2023-07-12 18:14:13,159 INFO [Listener at localhost/43601] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:14:13,169 DEBUG [Listener at localhost/43601] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:14:13,170 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,173 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,175 INFO [Listener at localhost/43601] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41341 connecting to ZooKeeper ensemble=127.0.0.1:61297 2023-07-12 18:14:13,181 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:413410x0, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:13,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41341-0x1015abe0af20001 connected 2023-07-12 18:14:13,182 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,184 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,185 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,187 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41341 2023-07-12 18:14:13,188 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41341 2023-07-12 18:14:13,188 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41341 2023-07-12 18:14:13,194 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41341 2023-07-12 18:14:13,195 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41341 2023-07-12 18:14:13,209 INFO [Listener at localhost/43601] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:13,209 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,209 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,210 INFO [Listener at localhost/43601] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:13,210 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,210 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:13,210 INFO [Listener at localhost/43601] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:13,212 INFO [Listener at localhost/43601] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39547 2023-07-12 18:14:13,213 INFO [Listener at localhost/43601] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:14:13,214 DEBUG [Listener at localhost/43601] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:14:13,215 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,220 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,223 INFO [Listener at localhost/43601] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39547 connecting to ZooKeeper ensemble=127.0.0.1:61297 2023-07-12 18:14:13,231 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:395470x0, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:13,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39547-0x1015abe0af20002 connected 2023-07-12 18:14:13,233 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,234 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,235 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,242 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39547 2023-07-12 18:14:13,243 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39547 2023-07-12 18:14:13,247 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39547 2023-07-12 18:14:13,247 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39547 2023-07-12 18:14:13,247 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39547 2023-07-12 18:14:13,260 INFO [Listener at localhost/43601] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 18:14:13,261 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,261 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,261 INFO [Listener at localhost/43601] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 18:14:13,261 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 18:14:13,261 INFO [Listener at localhost/43601] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 18:14:13,261 INFO [Listener at localhost/43601] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 18:14:13,263 INFO [Listener at localhost/43601] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45233 2023-07-12 18:14:13,264 INFO [Listener at localhost/43601] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 18:14:13,266 DEBUG [Listener at localhost/43601] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-12 18:14:13,267 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,269 INFO [Listener at localhost/43601] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,270 INFO [Listener at localhost/43601] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45233 connecting to ZooKeeper ensemble=127.0.0.1:61297 2023-07-12 18:14:13,273 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:452330x0, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 18:14:13,274 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:452330x0, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:14:13,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45233-0x1015abe0af20003 connected 2023-07-12 18:14:13,275 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:14:13,276 DEBUG [Listener at localhost/43601] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 18:14:13,279 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45233 2023-07-12 18:14:13,281 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45233 2023-07-12 18:14:13,285 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45233 2023-07-12 18:14:13,286 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45233 2023-07-12 18:14:13,288 DEBUG [Listener at localhost/43601] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45233 2023-07-12 18:14:13,293 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:13,304 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 18:14:13,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:13,331 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,331 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,331 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,331 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 18:14:13,333 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:13,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 18:14:13,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 18:14:13,338 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33521,1689185651624 from backup master directory 2023-07-12 18:14:13,350 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:13,350 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 18:14:13,351 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:13,351 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:13,355 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 18:14:13,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 18:14:13,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/hbase.id with ID: 321ada3c-609d-48a9-986c-d88857b86604 2023-07-12 18:14:13,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 18:14:13,575 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:13,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x09f171c4 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:13,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@706a9a0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:13,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:13,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 18:14:13,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 18:14:13,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 18:14:13,735 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:14:13,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:14:13,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:13,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store-tmp 2023-07-12 18:14:13,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:13,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:14:13,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:14:13,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,854 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:14:13,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:14:13,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/WALs/jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:13,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33521%2C1689185651624, suffix=, logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/WALs/jenkins-hbase4.apache.org,33521,1689185651624, archiveDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/oldWALs, maxLogs=10 2023-07-12 18:14:13,968 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK] 2023-07-12 18:14:13,976 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK] 2023-07-12 18:14:13,968 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK] 2023-07-12 18:14:13,989 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 18:14:14,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/WALs/jenkins-hbase4.apache.org,33521,1689185651624/jenkins-hbase4.apache.org%2C33521%2C1689185651624.1689185653901 2023-07-12 18:14:14,078 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK], DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK], DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK]] 2023-07-12 18:14:14,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:14,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:14,084 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,177 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,185 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 18:14:14,212 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 18:14:14,228 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:14,235 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,257 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 18:14:14,264 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:14,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61903181, jitterRate=-0.07757072150707245}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:14,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:14:14,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 18:14:14,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 18:14:14,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 18:14:14,294 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 18:14:14,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 18:14:14,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-12 18:14:14,334 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 18:14:14,370 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 18:14:14,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 18:14:14,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 18:14:14,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 18:14:14,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 18:14:14,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 18:14:14,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 18:14:14,431 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,433 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 18:14:14,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 18:14:14,450 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 18:14:14,455 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,455 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,456 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,455 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,455 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 18:14:14,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33521,1689185651624, sessionid=0x1015abe0af20000, setting cluster-up flag (Was=false) 2023-07-12 18:14:14,476 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,482 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 18:14:14,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:14,491 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:14,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 18:14:14,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:14,505 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp 2023-07-12 18:14:14,604 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 18:14:14,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 18:14:14,613 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(951): ClusterId : 321ada3c-609d-48a9-986c-d88857b86604 2023-07-12 18:14:14,626 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:14:14,631 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(951): ClusterId : 321ada3c-609d-48a9-986c-d88857b86604 2023-07-12 18:14:14,632 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(951): ClusterId : 321ada3c-609d-48a9-986c-d88857b86604 2023-07-12 18:14:14,635 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:14:14,636 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 18:14:14,639 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:14:14,639 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:14:14,642 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:14:14,642 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:14:14,644 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 18:14:14,644 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 18:14:14,645 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:14:14,647 DEBUG [RS:0;jenkins-hbase4:41341] zookeeper.ReadOnlyZKClient(139): Connect 0x5a50683e to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:14,647 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:14:14,648 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 18:14:14,671 DEBUG [RS:2;jenkins-hbase4:45233] zookeeper.ReadOnlyZKClient(139): Connect 0x7fa8686e to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:14,675 DEBUG [RS:1;jenkins-hbase4:39547] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc13d66 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:14,701 DEBUG [RS:0;jenkins-hbase4:41341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54979d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:14,702 DEBUG [RS:0;jenkins-hbase4:41341] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@50a8034e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:14:14,705 DEBUG [RS:2;jenkins-hbase4:45233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@716f89eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:14,705 DEBUG [RS:2;jenkins-hbase4:45233] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7550031e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:14:14,705 DEBUG [RS:1;jenkins-hbase4:39547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@506c26e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:14,706 DEBUG [RS:1;jenkins-hbase4:39547] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@443bc855, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:14:14,733 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39547 2023-07-12 18:14:14,734 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:45233 2023-07-12 18:14:14,741 INFO [RS:2;jenkins-hbase4:45233] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:14:14,741 INFO [RS:2;jenkins-hbase4:45233] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:14:14,745 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41341 2023-07-12 18:14:14,745 INFO [RS:0;jenkins-hbase4:41341] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:14:14,745 INFO [RS:0;jenkins-hbase4:41341] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:14:14,745 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 18:14:14,741 INFO [RS:1;jenkins-hbase4:39547] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 18:14:14,746 INFO [RS:0;jenkins-hbase4:41341] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,746 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 18:14:14,747 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:14:14,747 INFO [RS:2;jenkins-hbase4:45233] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,747 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:14:14,747 INFO [RS:1;jenkins-hbase4:39547] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 18:14:14,747 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 18:14:14,748 INFO [RS:1;jenkins-hbase4:39547] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:14,748 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 18:14:14,751 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33521,1689185651624 with isa=jenkins-hbase4.apache.org/172.31.14.131:41341, startcode=1689185653145 2023-07-12 18:14:14,751 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33521,1689185651624 with isa=jenkins-hbase4.apache.org/172.31.14.131:45233, startcode=1689185653260 2023-07-12 18:14:14,753 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33521,1689185651624 with isa=jenkins-hbase4.apache.org/172.31.14.131:39547, startcode=1689185653208 2023-07-12 18:14:14,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 18:14:14,779 DEBUG [RS:1;jenkins-hbase4:39547] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:14:14,779 DEBUG [RS:0;jenkins-hbase4:41341] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:14:14,782 DEBUG [RS:2;jenkins-hbase4:45233] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 18:14:14,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:14,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:14,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689185684813 2023-07-12 18:14:14,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 18:14:14,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 18:14:14,871 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:14:14,872 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 18:14:14,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 18:14:14,879 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:14,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 18:14:14,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 18:14:14,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 18:14:14,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 18:14:14,888 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53911, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:14:14,888 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39771, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:14:14,888 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36373, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 18:14:14,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 18:14:14,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 18:14:14,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 18:14:14,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 18:14:14,902 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33521] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 18:14:14,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689185654901,5,FailOnTimeoutGroup] 2023-07-12 18:14:14,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689185654903,5,FailOnTimeoutGroup] 2023-07-12 18:14:14,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 18:14:14,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:14,931 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:14,937 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:14,947 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 18:14:14,947 WARN [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 18:14:14,960 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:14,960 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43721 2023-07-12 18:14:14,960 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:14:14,966 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:14,966 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43721 2023-07-12 18:14:14,966 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:14:14,976 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:14,977 DEBUG [RS:2;jenkins-hbase4:45233] zookeeper.ZKUtil(162): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:14,977 DEBUG [RS:0;jenkins-hbase4:41341] zookeeper.ZKUtil(162): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:14,977 WARN [RS:2;jenkins-hbase4:45233] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:14,977 WARN [RS:0;jenkins-hbase4:41341] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:14,988 INFO [RS:2;jenkins-hbase4:45233] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:14,988 INFO [RS:0;jenkins-hbase4:41341] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:14,991 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:14,991 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:14,999 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45233,1689185653260] 2023-07-12 18:14:15,000 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41341,1689185653145] 2023-07-12 18:14:15,044 DEBUG [RS:2;jenkins-hbase4:45233] zookeeper.ZKUtil(162): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,044 DEBUG [RS:0;jenkins-hbase4:41341] zookeeper.ZKUtil(162): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,044 DEBUG [RS:2;jenkins-hbase4:45233] zookeeper.ZKUtil(162): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,045 DEBUG [RS:0;jenkins-hbase4:41341] zookeeper.ZKUtil(162): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,046 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:15,047 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:15,048 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:15,049 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33521,1689185651624 with isa=jenkins-hbase4.apache.org/172.31.14.131:39547, startcode=1689185653208 2023-07-12 18:14:15,051 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33521] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,064 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:15,064 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:43721 2023-07-12 18:14:15,064 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 18:14:15,068 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:15,068 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:15,068 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:14:15,068 DEBUG [RS:1;jenkins-hbase4:39547] zookeeper.ZKUtil(162): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,069 WARN [RS:1;jenkins-hbase4:39547] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 18:14:15,069 INFO [RS:1;jenkins-hbase4:39547] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:15,069 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1948): logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,069 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,071 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 18:14:15,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,075 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,078 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 18:14:15,080 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39547,1689185653208] 2023-07-12 18:14:15,089 INFO [RS:0;jenkins-hbase4:41341] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:14:15,091 INFO [RS:2;jenkins-hbase4:45233] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:14:15,114 DEBUG [RS:1;jenkins-hbase4:39547] zookeeper.ZKUtil(162): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,114 DEBUG [RS:1;jenkins-hbase4:39547] zookeeper.ZKUtil(162): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,115 DEBUG [RS:1;jenkins-hbase4:39547] zookeeper.ZKUtil(162): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,118 DEBUG [RS:1;jenkins-hbase4:39547] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 18:14:15,119 INFO [RS:1;jenkins-hbase4:39547] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 18:14:15,180 INFO [RS:1;jenkins-hbase4:39547] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:14:15,180 INFO [RS:0;jenkins-hbase4:41341] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:14:15,182 INFO [RS:2;jenkins-hbase4:45233] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 18:14:15,184 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:15,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:14:15,187 INFO [RS:2;jenkins-hbase4:45233] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:14:15,187 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,187 INFO [RS:0;jenkins-hbase4:41341] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:14:15,188 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:14:15,187 INFO [RS:1;jenkins-hbase4:39547] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 18:14:15,194 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,189 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,194 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:14:15,194 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 18:14:15,197 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/info 2023-07-12 18:14:15,198 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:14:15,199 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,200 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:14:15,205 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:14:15,206 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,207 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,206 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,207 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,207 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:14:15,207 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,207 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,208 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,209 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,209 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,209 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,209 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,209 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,209 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:15,210 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,210 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,210 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,210 DEBUG [RS:1;jenkins-hbase4:39547] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,210 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,210 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,211 DEBUG [RS:0;jenkins-hbase4:41341] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,215 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,215 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,215 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 18:14:15,215 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,216 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,216 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,216 DEBUG [RS:2;jenkins-hbase4:45233] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 18:14:15,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,217 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:14:15,223 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/table 2023-07-12 18:14:15,224 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:14:15,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,242 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,246 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,244 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740 2023-07-12 18:14:15,249 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,249 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,249 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,249 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,249 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,249 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,249 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,250 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740 2023-07-12 18:14:15,259 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:14:15,262 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:14:15,275 INFO [RS:0;jenkins-hbase4:41341] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:14:15,276 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:15,277 INFO [RS:2;jenkins-hbase4:45233] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:14:15,278 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73115943, jitterRate=0.08951245248317719}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:14:15,279 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:14:15,279 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:14:15,279 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:14:15,279 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:14:15,279 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:14:15,279 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:14:15,280 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:14:15,280 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:14:15,281 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41341,1689185653145-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,281 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45233,1689185653260-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,287 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 18:14:15,288 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 18:14:15,300 INFO [RS:1;jenkins-hbase4:39547] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 18:14:15,300 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39547,1689185653208-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:15,302 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 18:14:15,315 INFO [RS:2;jenkins-hbase4:45233] regionserver.Replication(203): jenkins-hbase4.apache.org,45233,1689185653260 started 2023-07-12 18:14:15,315 INFO [RS:0;jenkins-hbase4:41341] regionserver.Replication(203): jenkins-hbase4.apache.org,41341,1689185653145 started 2023-07-12 18:14:15,315 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,45233,1689185653260, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45233, sessionid=0x1015abe0af20003 2023-07-12 18:14:15,315 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,41341,1689185653145, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41341, sessionid=0x1015abe0af20001 2023-07-12 18:14:15,315 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:14:15,315 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:14:15,316 DEBUG [RS:0;jenkins-hbase4:41341] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,316 DEBUG [RS:2;jenkins-hbase4:45233] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,316 DEBUG [RS:0;jenkins-hbase4:41341] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41341,1689185653145' 2023-07-12 18:14:15,317 DEBUG [RS:2;jenkins-hbase4:45233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45233,1689185653260' 2023-07-12 18:14:15,317 DEBUG [RS:0;jenkins-hbase4:41341] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 18:14:15,317 DEBUG [RS:2;jenkins-hbase4:45233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 18:14:15,318 INFO [RS:1;jenkins-hbase4:39547] regionserver.Replication(203): jenkins-hbase4.apache.org,39547,1689185653208 started 2023-07-12 18:14:15,318 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39547,1689185653208, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39547, sessionid=0x1015abe0af20002 2023-07-12 18:14:15,318 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 18:14:15,318 DEBUG [RS:1;jenkins-hbase4:39547] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,319 DEBUG [RS:1;jenkins-hbase4:39547] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39547,1689185653208' 2023-07-12 18:14:15,319 DEBUG [RS:0;jenkins-hbase4:41341] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 18:14:15,319 DEBUG [RS:2;jenkins-hbase4:45233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 18:14:15,319 DEBUG [RS:1;jenkins-hbase4:39547] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 18:14:15,319 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:14:15,320 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:14:15,320 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:14:15,320 DEBUG [RS:1;jenkins-hbase4:39547] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 18:14:15,320 DEBUG [RS:0;jenkins-hbase4:41341] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:15,320 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:14:15,320 DEBUG [RS:0;jenkins-hbase4:41341] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41341,1689185653145' 2023-07-12 18:14:15,321 DEBUG [RS:0;jenkins-hbase4:41341] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:15,320 DEBUG [RS:2;jenkins-hbase4:45233] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,321 DEBUG [RS:2;jenkins-hbase4:45233] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45233,1689185653260' 2023-07-12 18:14:15,321 DEBUG [RS:2;jenkins-hbase4:45233] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:15,323 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 18:14:15,323 DEBUG [RS:0;jenkins-hbase4:41341] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:15,323 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 18:14:15,324 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 18:14:15,324 DEBUG [RS:1;jenkins-hbase4:39547] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:15,324 DEBUG [RS:1;jenkins-hbase4:39547] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39547,1689185653208' 2023-07-12 18:14:15,324 DEBUG [RS:1;jenkins-hbase4:39547] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:15,324 DEBUG [RS:0;jenkins-hbase4:41341] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:14:15,325 INFO [RS:0;jenkins-hbase4:41341] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:14:15,325 INFO [RS:0;jenkins-hbase4:41341] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:14:15,325 DEBUG [RS:1;jenkins-hbase4:39547] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:15,324 DEBUG [RS:2;jenkins-hbase4:45233] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:15,326 DEBUG [RS:1;jenkins-hbase4:39547] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:14:15,326 DEBUG [RS:2;jenkins-hbase4:45233] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 18:14:15,326 INFO [RS:1;jenkins-hbase4:39547] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:14:15,326 INFO [RS:2;jenkins-hbase4:45233] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 18:14:15,326 INFO [RS:1;jenkins-hbase4:39547] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:14:15,327 INFO [RS:2;jenkins-hbase4:45233] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 18:14:15,328 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 18:14:15,448 INFO [RS:0;jenkins-hbase4:41341] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41341%2C1689185653145, suffix=, logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,41341,1689185653145, archiveDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs, maxLogs=32 2023-07-12 18:14:15,448 INFO [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45233%2C1689185653260, suffix=, logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,45233,1689185653260, archiveDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs, maxLogs=32 2023-07-12 18:14:15,450 INFO [RS:1;jenkins-hbase4:39547] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39547%2C1689185653208, suffix=, logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,39547,1689185653208, archiveDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs, maxLogs=32 2023-07-12 18:14:15,480 DEBUG [jenkins-hbase4:33521] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 18:14:15,487 DEBUG [jenkins-hbase4:33521] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:15,495 DEBUG [jenkins-hbase4:33521] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:15,496 DEBUG [jenkins-hbase4:33521] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:15,496 DEBUG [jenkins-hbase4:33521] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:15,496 DEBUG [jenkins-hbase4:33521] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:15,523 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45233,1689185653260, state=OPENING 2023-07-12 18:14:15,535 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 18:14:15,537 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:15,538 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 18:14:15,539 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK] 2023-07-12 18:14:15,549 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK] 2023-07-12 18:14:15,550 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK] 2023-07-12 18:14:15,550 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK] 2023-07-12 18:14:15,551 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK] 2023-07-12 18:14:15,549 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK] 2023-07-12 18:14:15,554 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK] 2023-07-12 18:14:15,554 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK] 2023-07-12 18:14:15,557 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK] 2023-07-12 18:14:15,556 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:14:15,582 INFO [RS:1;jenkins-hbase4:39547] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,39547,1689185653208/jenkins-hbase4.apache.org%2C39547%2C1689185653208.1689185655453 2023-07-12 18:14:15,583 INFO [RS:0;jenkins-hbase4:41341] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,41341,1689185653145/jenkins-hbase4.apache.org%2C41341%2C1689185653145.1689185655463 2023-07-12 18:14:15,583 DEBUG [RS:1;jenkins-hbase4:39547] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK], DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK], DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK]] 2023-07-12 18:14:15,585 DEBUG [RS:0;jenkins-hbase4:41341] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK], DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK], DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK]] 2023-07-12 18:14:15,588 INFO [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,45233,1689185653260/jenkins-hbase4.apache.org%2C45233%2C1689185653260.1689185655454 2023-07-12 18:14:15,591 DEBUG [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK], DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK], DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK]] 2023-07-12 18:14:15,772 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:15,776 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:14:15,781 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:14:15,803 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 18:14:15,804 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 18:14:15,809 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45233%2C1689185653260.meta, suffix=.meta, logDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,45233,1689185653260, archiveDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs, maxLogs=32 2023-07-12 18:14:15,839 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK] 2023-07-12 18:14:15,840 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK] 2023-07-12 18:14:15,843 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK] 2023-07-12 18:14:15,863 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,45233,1689185653260/jenkins-hbase4.apache.org%2C45233%2C1689185653260.meta.1689185655811.meta 2023-07-12 18:14:15,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41285,DS-0e4ce114-e724-494b-80dd-e32dbca7bf1c,DISK], DatanodeInfoWithStorage[127.0.0.1:35669,DS-5d0f2bfc-6f65-4cd5-8e6a-0afcba6f92b1,DISK], DatanodeInfoWithStorage[127.0.0.1:43957,DS-a0a8375d-18df-49ec-a60a-04e217ae76fd,DISK]] 2023-07-12 18:14:15,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:15,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 18:14:15,870 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:15,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 18:14:15,874 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 18:14:15,876 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 18:14:15,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 18:14:15,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:15,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 18:14:15,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 18:14:15,897 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 18:14:15,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/info 2023-07-12 18:14:15,902 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/info 2023-07-12 18:14:15,903 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 18:14:15,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,904 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 18:14:15,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:14:15,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/rep_barrier 2023-07-12 18:14:15,907 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 18:14:15,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 18:14:15,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/table 2023-07-12 18:14:15,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/table 2023-07-12 18:14:15,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 18:14:15,913 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:15,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740 2023-07-12 18:14:15,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740 2023-07-12 18:14:15,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 18:14:15,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 18:14:15,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67619034, jitterRate=0.007602125406265259}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 18:14:15,936 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 18:14:15,953 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689185655764 2023-07-12 18:14:15,978 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 18:14:15,979 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 18:14:15,980 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,45233,1689185653260, state=OPEN 2023-07-12 18:14:15,986 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 18:14:15,987 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 18:14:15,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 18:14:15,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,45233,1689185653260 in 431 msec 2023-07-12 18:14:16,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 18:14:16,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 694 msec 2023-07-12 18:14:16,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.3910 sec 2023-07-12 18:14:16,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689185656019, completionTime=-1 2023-07-12 18:14:16,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 18:14:16,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 18:14:16,109 DEBUG [hconnection-0x78e748cd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:16,116 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:16,147 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 18:14:16,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689185716148 2023-07-12 18:14:16,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689185776148 2023-07-12 18:14:16,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 127 msec 2023-07-12 18:14:16,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33521,1689185651624-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33521,1689185651624-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33521,1689185651624-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33521, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 18:14:16,197 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 18:14:16,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 18:14:16,208 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:16,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 18:14:16,226 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:16,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:16,254 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,258 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a empty. 2023-07-12 18:14:16,259 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,259 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 18:14:16,307 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:16,310 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8f7311c23e57dcb89e171c537cff8d9a, NAME => 'hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:16,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:16,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 8f7311c23e57dcb89e171c537cff8d9a, disabling compactions & flushes 2023-07-12 18:14:16,341 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. after waiting 0 ms 2023-07-12 18:14:16,341 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,342 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,342 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 8f7311c23e57dcb89e171c537cff8d9a: 2023-07-12 18:14:16,347 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:16,366 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689185656350"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185656350"}]},"ts":"1689185656350"} 2023-07-12 18:14:16,402 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:14:16,404 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:16,409 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185656404"}]},"ts":"1689185656404"} 2023-07-12 18:14:16,420 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 18:14:16,426 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:16,428 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:16,428 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:16,428 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:16,428 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:16,431 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8f7311c23e57dcb89e171c537cff8d9a, ASSIGN}] 2023-07-12 18:14:16,436 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=8f7311c23e57dcb89e171c537cff8d9a, ASSIGN 2023-07-12 18:14:16,438 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=8f7311c23e57dcb89e171c537cff8d9a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41341,1689185653145; forceNewPlan=false, retain=false 2023-07-12 18:14:16,590 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:14:16,592 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8f7311c23e57dcb89e171c537cff8d9a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:16,592 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689185656591"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185656591"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185656591"}]},"ts":"1689185656591"} 2023-07-12 18:14:16,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 8f7311c23e57dcb89e171c537cff8d9a, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:14:16,751 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:16,752 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:14:16,755 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:14:16,761 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,761 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8f7311c23e57dcb89e171c537cff8d9a, NAME => 'hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:16,761 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. service=AccessControlService 2023-07-12 18:14:16,762 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:16,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:16,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,763 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,765 INFO [StoreOpener-8f7311c23e57dcb89e171c537cff8d9a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,768 DEBUG [StoreOpener-8f7311c23e57dcb89e171c537cff8d9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/info 2023-07-12 18:14:16,768 DEBUG [StoreOpener-8f7311c23e57dcb89e171c537cff8d9a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/info 2023-07-12 18:14:16,768 INFO [StoreOpener-8f7311c23e57dcb89e171c537cff8d9a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8f7311c23e57dcb89e171c537cff8d9a columnFamilyName info 2023-07-12 18:14:16,769 INFO [StoreOpener-8f7311c23e57dcb89e171c537cff8d9a-1] regionserver.HStore(310): Store=8f7311c23e57dcb89e171c537cff8d9a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:16,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,772 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,776 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:14:16,780 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:16,781 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8f7311c23e57dcb89e171c537cff8d9a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73214739, jitterRate=0.09098462760448456}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:16,781 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8f7311c23e57dcb89e171c537cff8d9a: 2023-07-12 18:14:16,783 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a., pid=6, masterSystemTime=1689185656751 2023-07-12 18:14:16,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,789 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:14:16,790 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=8f7311c23e57dcb89e171c537cff8d9a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:16,791 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689185656790"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185656790"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185656790"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185656790"}]},"ts":"1689185656790"} 2023-07-12 18:14:16,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 18:14:16,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 8f7311c23e57dcb89e171c537cff8d9a, server=jenkins-hbase4.apache.org,41341,1689185653145 in 199 msec 2023-07-12 18:14:16,804 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 18:14:16,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=8f7311c23e57dcb89e171c537cff8d9a, ASSIGN in 369 msec 2023-07-12 18:14:16,807 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:16,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185656807"}]},"ts":"1689185656807"} 2023-07-12 18:14:16,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 18:14:16,812 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:16,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 603 msec 2023-07-12 18:14:16,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 18:14:16,831 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 18:14:16,831 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:16,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:16,857 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:16,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 18:14:16,885 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 18:14:16,892 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-12 18:14:16,903 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 18:14:16,916 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 18:14:16,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-12 18:14:16,930 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 18:14:16,933 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 18:14:16,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.582sec 2023-07-12 18:14:16,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 18:14:16,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 18:14:16,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 18:14:16,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33521,1689185651624-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 18:14:16,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33521,1689185651624-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 18:14:16,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:16,967 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 18:14:16,970 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:16,972 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:16,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 18:14:16,977 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:16,978 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65 empty. 2023-07-12 18:14:16,981 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:16,981 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 18:14:16,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,012 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:17,015 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8e5f89a25d2209f833349b3fdabecf65, NAME => 'hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:17,038 DEBUG [Listener at localhost/43601] zookeeper.ReadOnlyZKClient(139): Connect 0x7b401a43 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:17,045 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:17,046 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 8e5f89a25d2209f833349b3fdabecf65, disabling compactions & flushes 2023-07-12 18:14:17,046 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,046 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,046 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. after waiting 0 ms 2023-07-12 18:14:17,046 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,046 DEBUG [Listener at localhost/43601] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39491944, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:17,046 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,047 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 8e5f89a25d2209f833349b3fdabecf65: 2023-07-12 18:14:17,053 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:17,056 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689185657056"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185657056"}]},"ts":"1689185657056"} 2023-07-12 18:14:17,060 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 18:14:17,062 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:17,062 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185657062"}]},"ts":"1689185657062"} 2023-07-12 18:14:17,069 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 18:14:17,076 DEBUG [hconnection-0x333c767f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:17,076 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:17,077 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:17,077 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:17,077 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:17,077 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:17,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8e5f89a25d2209f833349b3fdabecf65, ASSIGN}] 2023-07-12 18:14:17,082 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=8e5f89a25d2209f833349b3fdabecf65, ASSIGN 2023-07-12 18:14:17,084 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=8e5f89a25d2209f833349b3fdabecf65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:14:17,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,092 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:17,094 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:14:17,094 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 18:14:17,094 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/test.cache.data in system properties and HBase conf 2023-07-12 18:14:17,094 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 18:14:17,094 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop.log.dir in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:17,095 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/nfs.dump.dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 18:14:17,096 INFO [Listener at localhost/43601] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 18:14:17,234 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:14:17,236 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8e5f89a25d2209f833349b3fdabecf65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:17,236 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689185657235"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185657235"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185657235"}]},"ts":"1689185657235"} 2023-07-12 18:14:17,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 8e5f89a25d2209f833349b3fdabecf65, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:14:17,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,408 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e5f89a25d2209f833349b3fdabecf65, NAME => 'hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:14:17,409 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. service=AccessControlService 2023-07-12 18:14:17,409 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:17,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:17,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,414 INFO [StoreOpener-8e5f89a25d2209f833349b3fdabecf65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,416 DEBUG [StoreOpener-8e5f89a25d2209f833349b3fdabecf65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/l 2023-07-12 18:14:17,416 DEBUG [StoreOpener-8e5f89a25d2209f833349b3fdabecf65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/l 2023-07-12 18:14:17,417 INFO [StoreOpener-8e5f89a25d2209f833349b3fdabecf65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e5f89a25d2209f833349b3fdabecf65 columnFamilyName l 2023-07-12 18:14:17,418 INFO [StoreOpener-8e5f89a25d2209f833349b3fdabecf65-1] regionserver.HStore(310): Store=8e5f89a25d2209f833349b3fdabecf65/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:17,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,422 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:14:17,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:17,464 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8e5f89a25d2209f833349b3fdabecf65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67145068, jitterRate=5.394816398620605E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:17,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8e5f89a25d2209f833349b3fdabecf65: 2023-07-12 18:14:17,467 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65., pid=11, masterSystemTime=1689185657397 2023-07-12 18:14:17,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:14:17,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=8e5f89a25d2209f833349b3fdabecf65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:17,474 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689185657474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185657474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185657474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185657474"}]},"ts":"1689185657474"} 2023-07-12 18:14:17,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 18:14:17,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 8e5f89a25d2209f833349b3fdabecf65, server=jenkins-hbase4.apache.org,45233,1689185653260 in 235 msec 2023-07-12 18:14:17,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 18:14:17,488 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=8e5f89a25d2209f833349b3fdabecf65, ASSIGN in 405 msec 2023-07-12 18:14:17,489 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:17,489 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185657489"}]},"ts":"1689185657489"} 2023-07-12 18:14:17,492 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 18:14:17,496 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:17,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 531 msec 2023-07-12 18:14:17,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 18:14:17,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 18:14:17,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 18:14:18,577 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:18,990 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:18,997 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33695_jobhistory____.c86z8l/webapp 2023-07-12 18:14:19,189 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 18:14:19,190 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:19,190 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:19,195 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:19,312 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:19,722 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:20,396 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 18:14:20,450 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33695 2023-07-12 18:14:21,458 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:14:21,747 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 18:14:21,749 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 18:14:21,750 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 18:14:21,759 WARN [Listener at jenkins-hbase4.apache.org/35861] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:21,810 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:21,810 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 18:14:21,811 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:21,811 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 18:14:21,811 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 18:14:21,811 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 18:14:21,811 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:21,811 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 18:14:21,811 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:14:21,811 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 18:14:21,876 WARN [Listener at jenkins-hbase4.apache.org/35861] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 18:14:21,877 INFO [Listener at jenkins-hbase4.apache.org/35861] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:21,884 INFO [Listener at jenkins-hbase4.apache.org/35861] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42453_cluster____.ylddv4/webapp 2023-07-12 18:14:21,956 INFO [Listener at jenkins-hbase4.apache.org/35861] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:21,957 INFO [Listener at jenkins-hbase4.apache.org/35861] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 18:14:21,957 INFO [Listener at jenkins-hbase4.apache.org/35861] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:21,957 INFO [Listener at jenkins-hbase4.apache.org/35861] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:21,970 INFO [Listener at jenkins-hbase4.apache.org/35861] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,179 INFO [Listener at jenkins-hbase4.apache.org/35861] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,323 INFO [Listener at jenkins-hbase4.apache.org/35861] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,335 INFO [Listener at jenkins-hbase4.apache.org/35861] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42453 2023-07-12 18:14:22,830 WARN [Listener at jenkins-hbase4.apache.org/44727] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:22,864 WARN [Listener at jenkins-hbase4.apache.org/44727] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 18:14:22,865 INFO [Listener at jenkins-hbase4.apache.org/44727] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:22,885 INFO [Listener at jenkins-hbase4.apache.org/44727] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_33585_node____i6bm4w/webapp 2023-07-12 18:14:22,943 INFO [Listener at jenkins-hbase4.apache.org/44727] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 18:14:22,943 INFO [Listener at jenkins-hbase4.apache.org/44727] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:22,944 INFO [Listener at jenkins-hbase4.apache.org/44727] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:22,944 INFO [Listener at jenkins-hbase4.apache.org/44727] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:22,955 INFO [Listener at jenkins-hbase4.apache.org/44727] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:22,978 INFO [Listener at jenkins-hbase4.apache.org/44727] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,091 INFO [Listener at jenkins-hbase4.apache.org/44727] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,118 INFO [Listener at jenkins-hbase4.apache.org/44727] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:33585 2023-07-12 18:14:23,426 WARN [Listener at jenkins-hbase4.apache.org/36331] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 18:14:23,435 WARN [Listener at jenkins-hbase4.apache.org/36331] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 18:14:23,436 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 18:14:23,449 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45825_node____iyvhqw/webapp 2023-07-12 18:14:23,527 INFO [Listener at jenkins-hbase4.apache.org/36331] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 18:14:23,528 INFO [Listener at jenkins-hbase4.apache.org/36331] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 18:14:23,528 INFO [Listener at jenkins-hbase4.apache.org/36331] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 18:14:23,528 INFO [Listener at jenkins-hbase4.apache.org/36331] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 18:14:23,541 INFO [Listener at jenkins-hbase4.apache.org/36331] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,569 INFO [Listener at jenkins-hbase4.apache.org/36331] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,665 INFO [Listener at jenkins-hbase4.apache.org/36331] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 18:14:23,705 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45825 2023-07-12 18:14:23,739 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 18:14:23,741 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:23,829 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=284, ProcessCount=174, AvailableMemoryMB=6923 2023-07-12 18:14:23,829 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-12 18:14:23,846 DEBUG [Listener at jenkins-hbase4.apache.org/36331] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 18:14:23,852 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 18:14:23,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:23,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:23,866 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:23,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 18:14:23,870 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:23,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:23,876 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:23,880 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 empty. 2023-07-12 18:14:23,880 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:23,882 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:23,884 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 empty. 2023-07-12 18:14:23,884 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:23,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 18:14:23,921 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:23,923 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 91ae65e6610a4036f9a8c618fd46ef22, NAME => 'testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:23,923 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1cd72e3893d970c2395ade5acd6692c1, NAME => 'testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:23,968 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:23,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 1cd72e3893d970c2395ade5acd6692c1, disabling compactions & flushes 2023-07-12 18:14:23,969 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:23,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:23,969 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 91ae65e6610a4036f9a8c618fd46ef22, disabling compactions & flushes 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. after waiting 0 ms 2023-07-12 18:14:23,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:23,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 1cd72e3893d970c2395ade5acd6692c1: 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. after waiting 0 ms 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:23,974 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:23,974 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 91ae65e6610a4036f9a8c618fd46ef22: 2023-07-12 18:14:23,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:23,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:23,980 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185663980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185663980"}]},"ts":"1689185663980"} 2023-07-12 18:14:23,980 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185663980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185663980"}]},"ts":"1689185663980"} 2023-07-12 18:14:24,029 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:14:24,032 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:24,032 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185664032"}]},"ts":"1689185664032"} 2023-07-12 18:14:24,035 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 18:14:24,040 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:24,042 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:24,042 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:24,042 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:24,042 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:24,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, ASSIGN}] 2023-07-12 18:14:24,045 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, ASSIGN 2023-07-12 18:14:24,045 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, ASSIGN 2023-07-12 18:14:24,047 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39547,1689185653208; forceNewPlan=false, retain=false 2023-07-12 18:14:24,047 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:14:24,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:24,197 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:14:24,200 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1cd72e3893d970c2395ade5acd6692c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:24,200 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=91ae65e6610a4036f9a8c618fd46ef22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:24,200 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185664199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185664199"}]},"ts":"1689185664199"} 2023-07-12 18:14:24,200 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664199"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185664199"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185664199"}]},"ts":"1689185664199"} 2023-07-12 18:14:24,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 1cd72e3893d970c2395ade5acd6692c1, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:14:24,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 91ae65e6610a4036f9a8c618fd46ef22, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:14:24,364 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:24,364 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:14:24,369 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59906, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:14:24,370 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:24,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1cd72e3893d970c2395ade5acd6692c1, NAME => 'testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:14:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. service=AccessControlService 2023-07-12 18:14:24,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,379 INFO [StoreOpener-1cd72e3893d970c2395ade5acd6692c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,381 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:24,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91ae65e6610a4036f9a8c618fd46ef22, NAME => 'testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:14:24,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. service=AccessControlService 2023-07-12 18:14:24,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:24,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:24,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,384 DEBUG [StoreOpener-1cd72e3893d970c2395ade5acd6692c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf 2023-07-12 18:14:24,384 DEBUG [StoreOpener-1cd72e3893d970c2395ade5acd6692c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf 2023-07-12 18:14:24,385 INFO [StoreOpener-1cd72e3893d970c2395ade5acd6692c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1cd72e3893d970c2395ade5acd6692c1 columnFamilyName cf 2023-07-12 18:14:24,385 INFO [StoreOpener-91ae65e6610a4036f9a8c618fd46ef22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,386 INFO [StoreOpener-1cd72e3893d970c2395ade5acd6692c1-1] regionserver.HStore(310): Store=1cd72e3893d970c2395ade5acd6692c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:24,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,388 DEBUG [StoreOpener-91ae65e6610a4036f9a8c618fd46ef22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf 2023-07-12 18:14:24,388 DEBUG [StoreOpener-91ae65e6610a4036f9a8c618fd46ef22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf 2023-07-12 18:14:24,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,389 INFO [StoreOpener-91ae65e6610a4036f9a8c618fd46ef22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91ae65e6610a4036f9a8c618fd46ef22 columnFamilyName cf 2023-07-12 18:14:24,390 INFO [StoreOpener-91ae65e6610a4036f9a8c618fd46ef22-1] regionserver.HStore(310): Store=91ae65e6610a4036f9a8c618fd46ef22/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:24,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:24,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:24,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:24,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1cd72e3893d970c2395ade5acd6692c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63117896, jitterRate=-0.05947005748748779}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:24,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1cd72e3893d970c2395ade5acd6692c1: 2023-07-12 18:14:24,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1., pid=15, masterSystemTime=1689185664360 2023-07-12 18:14:24,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:24,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91ae65e6610a4036f9a8c618fd46ef22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65475424, jitterRate=-0.024340152740478516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:24,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91ae65e6610a4036f9a8c618fd46ef22: 2023-07-12 18:14:24,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22., pid=16, masterSystemTime=1689185664364 2023-07-12 18:14:24,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:24,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:24,421 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=1cd72e3893d970c2395ade5acd6692c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:24,421 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664421"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185664421"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185664421"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185664421"}]},"ts":"1689185664421"} 2023-07-12 18:14:24,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:24,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:24,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=91ae65e6610a4036f9a8c618fd46ef22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:24,432 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-12 18:14:24,434 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 1cd72e3893d970c2395ade5acd6692c1, server=jenkins-hbase4.apache.org,45233,1689185653260 in 223 msec 2023-07-12 18:14:24,434 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, ASSIGN in 390 msec 2023-07-12 18:14:24,434 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185664428"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185664428"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185664428"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185664428"}]},"ts":"1689185664428"} 2023-07-12 18:14:24,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-12 18:14:24,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 91ae65e6610a4036f9a8c618fd46ef22, server=jenkins-hbase4.apache.org,39547,1689185653208 in 231 msec 2023-07-12 18:14:24,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 18:14:24,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, ASSIGN in 399 msec 2023-07-12 18:14:24,450 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:24,451 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185664451"}]},"ts":"1689185664451"} 2023-07-12 18:14:24,454 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 18:14:24,458 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:24,464 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 18:14:24,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:24,482 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 18:14:24,516 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,516 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,516 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:14:24,516 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,516 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:24,527 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:24,527 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:24,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,529 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,529 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:24,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 668 msec 2023-07-12 18:14:24,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 18:14:24,981 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 18:14:24,981 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-12 18:14:24,982 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:24,987 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-12 18:14:24,988 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:24,988 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-12 18:14:25,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185665003 (current time:1689185665003). 2023-07-12 18:14:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:25,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x53060d0e to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d4f125a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,019 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53060d0e to 127.0.0.1:61297 2023-07-12 18:14:25,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x4ab38788 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30de80e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,035 DEBUG [hconnection-0x18186fed-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,036 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ab38788 to 127.0.0.1:61297 2023-07-12 18:14:25,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 18:14:25,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:25,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,100 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,102 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689186265102 2023-07-12 18:14:25,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,102 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 18:14:25,105 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,110 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:25,110 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:25,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-12 18:14:25,116 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,118 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689186265118 2023-07-12 18:14:25,155 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,155 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 18:14:25,155 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,157 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 18:14:25,157 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 18:14:25,158 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,158 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,166 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,167 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,167 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,166 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,167 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,167 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,168 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,168 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:25,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,169 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,173 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,173 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,172 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,174 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,173 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,175 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,176 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,179 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,180 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,180 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,180 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,180 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,180 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,180 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,181 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,181 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,181 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,181 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e7f89aa[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e7f89aa[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:25,188 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 18:14:25,188 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,192 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,192 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,192 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,192 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,192 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:14:25,192 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,193 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,193 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:25,193 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,194 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,194 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,194 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:25,195 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. started... 2023-07-12 18:14:25,195 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,195 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. started... 2023-07-12 18:14:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,196 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,199 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91ae65e6610a4036f9a8c618fd46ef22: 2023-07-12 18:14:25,199 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cd72e3893d970c2395ade5acd6692c1: 2023-07-12 18:14:25,201 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,201 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,207 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:25,207 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:25,210 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:25,211 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,210 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:25,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:25,219 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:25,277 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. completed. 2023-07-12 18:14:25,277 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:25,277 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:25,277 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:25,277 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,278 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:14:25,280 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,280 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,281 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,284 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. completed. 2023-07-12 18:14:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,284 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,284 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:14:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,286 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,286 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,286 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,286 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:14:25,289 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 18:14:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:14:25,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 18:14:25,295 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 18:14:25,295 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:25,295 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:25,295 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,295 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:25,299 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,299 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,299 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,299 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,299 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,300 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,299 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,301 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,301 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,302 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,306 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,307 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,308 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,328 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,328 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,328 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,330 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,329 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:25,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:25,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:25,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,420 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:25,423 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:14:25,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 18:14:25,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,451 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:25,451 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689185665102Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689185665329 (+227 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689185665329Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689185665343 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689185665374 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689185665450 (+76 ms) 2023-07-12 18:14:25,453 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,456 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 348 msec 2023-07-12 18:14:25,723 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:25,755 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45233] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:25,761 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39547] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:25,769 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 18:14:25,770 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:25,773 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:25,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185665807 (current time:1689185665807). 2023-07-12 18:14:25,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:25,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x2a6801c0 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ac50d4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,821 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a6801c0 to 127.0.0.1:61297 2023-07-12 18:14:25,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x0c3988f4 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:25,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66b5eeb2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:25,844 DEBUG [hconnection-0x64983045-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:25,848 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:25,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c3988f4 to 127.0.0.1:61297 2023-07-12 18:14:25,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:25,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 18:14:25,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:25,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,863 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,865 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689186265865 2023-07-12 18:14:25,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 18:14:25,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 18:14:25,867 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:25,867 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:25,870 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 18:14:25,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,872 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-12 18:14:25,874 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:25,875 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689186265875 2023-07-12 18:14:25,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 18:14:25,900 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 18:14:25,900 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,901 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 18:14:25,901 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 18:14:25,902 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,902 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,903 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,903 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,903 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,903 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:25,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,904 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,904 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,904 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,904 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,905 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,906 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 18:14:25,907 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,907 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,908 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 18:14:25,908 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 18:14:25,908 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:25,909 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 18:14:25,909 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 18:14:25,909 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 18:14:25,911 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,912 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,913 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,914 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,915 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,915 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,915 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,915 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,915 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:25,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d47ffae[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:25,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:25,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:25,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 18:14:25,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d47ffae[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:25,921 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 18:14:25,921 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,926 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,927 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,927 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:25,927 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:25,928 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. started... 2023-07-12 18:14:25,928 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. started... 2023-07-12 18:14:25,927 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:25,927 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 18:14:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:25,928 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1cd72e3893d970c2395ade5acd6692c1 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 18:14:25,928 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 91ae65e6610a4036f9a8c618fd46ef22 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 18:14:25,928 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:14:25,928 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:25,928 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:25,931 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:25,967 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:25,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:25,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:25,969 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:26,040 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/.tmp/cf/81a99480e628461188ec7c3ee1709550 2023-07-12 18:14:26,048 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/.tmp/cf/495dc041d9cd4b199be519cdf8c1373b 2023-07-12 18:14:26,099 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/.tmp/cf/81a99480e628461188ec7c3ee1709550 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf/81a99480e628461188ec7c3ee1709550 2023-07-12 18:14:26,099 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/.tmp/cf/495dc041d9cd4b199be519cdf8c1373b as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf/495dc041d9cd4b199be519cdf8c1373b 2023-07-12 18:14:26,113 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf/81a99480e628461188ec7c3ee1709550, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 18:14:26,119 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 1cd72e3893d970c2395ade5acd6692c1 in 191ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:26,119 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 18:14:26,120 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1cd72e3893d970c2395ade5acd6692c1: 2023-07-12 18:14:26,121 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:26,121 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:26,122 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf/81a99480e628461188ec7c3ee1709550] hfiles 2023-07-12 18:14:26,122 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf/81a99480e628461188ec7c3ee1709550 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:26,127 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf/495dc041d9cd4b199be519cdf8c1373b, entries=47, sequenceid=6, filesize=8.0 K 2023-07-12 18:14:26,131 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 91ae65e6610a4036f9a8c618fd46ef22 in 203ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:26,132 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 91ae65e6610a4036f9a8c618fd46ef22: 2023-07-12 18:14:26,132 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:26,132 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:26,132 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf/495dc041d9cd4b199be519cdf8c1373b] hfiles 2023-07-12 18:14:26,132 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf/495dc041d9cd4b199be519cdf8c1373b for snapshot=snaptb0-testExportWithTargetName 2023-07-12 18:14:26,167 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. completed. 2023-07-12 18:14:26,167 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:26,167 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:26,168 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:14:26,169 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:26,170 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,170 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:26,171 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:26,171 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:26,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:26,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:26,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:26,171 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:14:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:14:26,176 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 18:14:26,185 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. completed. 2023-07-12 18:14:26,185 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 18:14:26,185 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:14:26,187 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 18:14:26,187 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,187 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:26,188 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 18:14:26,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:26,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:26,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:26,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:26,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:14:26,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 18:14:26,195 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 18:14:26,196 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:26,196 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:26,196 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 18:14:26,196 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:26,199 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,199 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,199 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:26,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,199 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:26,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,199 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:26,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:26,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:26,200 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:26,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:26,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,201 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:26,202 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:26,204 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 18:14:26,205 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,205 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,220 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:26,220 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:26,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:26,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:26,220 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:26,220 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,221 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:26,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,221 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 18:14:26,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:26,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 18:14:26,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:26,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:26,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:26,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:26,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,223 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:26,223 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,223 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:26,223 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:26,223 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,223 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:26,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:26,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,298 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 18:14:26,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,299 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 18:14:26,299 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689185665865Consolidate snapshot: snaptb0-testExportWithTargetName at 1689185666222 (+357 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689185666222Writing data manifest for snaptb0-testExportWithTargetName at 1689185666229 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689185666250 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689185666298 (+48 ms) 2023-07-12 18:14:26,301 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 18:14:26,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 435 msec 2023-07-12 18:14:26,472 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:26,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 18:14:26,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:26,476 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476 2023-07-12 18:14:26,476 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43721, tgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476, rawTgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:26,521 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:26,521 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1479774499_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 18:14:26,521 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 18:14:26,538 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 18:14:26,596 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:26,596 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:26,597 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:26,597 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,616 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-1432102398172433793.jar 2023-07-12 18:14:27,617 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,618 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,703 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-6375559882555730918.jar 2023-07-12 18:14:27,704 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,705 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,706 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,706 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,707 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,708 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:27,708 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:14:27,709 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:14:27,710 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:14:27,710 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:14:27,711 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:14:27,712 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:14:27,712 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:14:27,713 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:14:27,714 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:14:27,715 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:14:27,722 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,723 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,723 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:27,723 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,724 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:27,725 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:27,725 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:28,829 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:14:28,836 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 18:14:28,848 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 18:14:29,372 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:29,377 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:29,888 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:14:29,965 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:35,473 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:37,726 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:40,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:42,800 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:14:42,803 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:14:42,812 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 18:14:42,812 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:14:42,813 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:14:42,813 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 18:14:42,814 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 18:14:42,814 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 18:14:42,814 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476/.hbase-snapshot/testExportWithTargetName 2023-07-12 18:14:42,814 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 18:14:42,814 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185666476/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 18:14:42,825 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 18:14:42,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-12 18:14:42,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:42,842 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185682842"}]},"ts":"1689185682842"} 2023-07-12 18:14:42,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:42,844 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 18:14:42,900 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 18:14:42,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, UNASSIGN}] 2023-07-12 18:14:42,905 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, UNASSIGN 2023-07-12 18:14:42,905 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, UNASSIGN 2023-07-12 18:14:42,906 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1cd72e3893d970c2395ade5acd6692c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:42,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=91ae65e6610a4036f9a8c618fd46ef22, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:42,906 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185682906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185682906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185682906"}]},"ts":"1689185682906"} 2023-07-12 18:14:42,906 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185682906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185682906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185682906"}]},"ts":"1689185682906"} 2023-07-12 18:14:42,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 1cd72e3893d970c2395ade5acd6692c1, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:14:42,909 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 91ae65e6610a4036f9a8c618fd46ef22, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:14:42,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:43,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:43,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:43,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1cd72e3893d970c2395ade5acd6692c1, disabling compactions & flushes 2023-07-12 18:14:43,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91ae65e6610a4036f9a8c618fd46ef22, disabling compactions & flushes 2023-07-12 18:14:43,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:43,068 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:43,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:43,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:43,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. after waiting 0 ms 2023-07-12 18:14:43,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:43,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. after waiting 0 ms 2023-07-12 18:14:43,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:43,087 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:14:43,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:14:43,088 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:43,089 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:43,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1. 2023-07-12 18:14:43,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22. 2023-07-12 18:14:43,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1cd72e3893d970c2395ade5acd6692c1: 2023-07-12 18:14:43,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91ae65e6610a4036f9a8c618fd46ef22: 2023-07-12 18:14:43,093 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:43,094 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=1cd72e3893d970c2395ade5acd6692c1, regionState=CLOSED 2023-07-12 18:14:43,094 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185683094"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185683094"}]},"ts":"1689185683094"} 2023-07-12 18:14:43,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:43,095 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=91ae65e6610a4036f9a8c618fd46ef22, regionState=CLOSED 2023-07-12 18:14:43,095 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689185683095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185683095"}]},"ts":"1689185683095"} 2023-07-12 18:14:43,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-12 18:14:43,099 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 1cd72e3893d970c2395ade5acd6692c1, server=jenkins-hbase4.apache.org,45233,1689185653260 in 188 msec 2023-07-12 18:14:43,100 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-12 18:14:43,100 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 91ae65e6610a4036f9a8c618fd46ef22, server=jenkins-hbase4.apache.org,39547,1689185653208 in 188 msec 2023-07-12 18:14:43,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1cd72e3893d970c2395ade5acd6692c1, UNASSIGN in 197 msec 2023-07-12 18:14:43,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 18:14:43,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=91ae65e6610a4036f9a8c618fd46ef22, UNASSIGN in 198 msec 2023-07-12 18:14:43,103 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185683103"}]},"ts":"1689185683103"} 2023-07-12 18:14:43,105 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 18:14:43,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:43,153 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 18:14:43,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 323 msec 2023-07-12 18:14:43,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 18:14:43,446 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 18:14:43,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-12 18:14:43,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,462 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 18:14:43,464 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,468 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 18:14:43,470 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:43,470 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:43,474 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/recovered.edits] 2023-07-12 18:14:43,474 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/recovered.edits] 2023-07-12 18:14:43,482 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf/81a99480e628461188ec7c3ee1709550 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/cf/81a99480e628461188ec7c3ee1709550 2023-07-12 18:14:43,482 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf/495dc041d9cd4b199be519cdf8c1373b to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/cf/495dc041d9cd4b199be519cdf8c1373b 2023-07-12 18:14:43,486 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1/recovered.edits/9.seqid 2023-07-12 18:14:43,487 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22/recovered.edits/9.seqid 2023-07-12 18:14:43,488 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/1cd72e3893d970c2395ade5acd6692c1 2023-07-12 18:14:43,488 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportWithTargetName/91ae65e6610a4036f9a8c618fd46ef22 2023-07-12 18:14:43,488 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 18:14:43,491 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,513 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 18:14:43,592 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,592 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,592 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,593 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 18:14:43,594 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 18:14:43,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 18:14:43,598 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,598 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 18:14:43,598 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185683598"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:43,598 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185683598"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:43,601 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:14:43,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1cd72e3893d970c2395ade5acd6692c1, NAME => 'testtb-testExportWithTargetName,,1689185663859.1cd72e3893d970c2395ade5acd6692c1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 91ae65e6610a4036f9a8c618fd46ef22, NAME => 'testtb-testExportWithTargetName,1,1689185663859.91ae65e6610a4036f9a8c618fd46ef22.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:14:43,601 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 18:14:43,601 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185683601"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:43,604 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 18:14:43,669 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,669 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:43,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 18:14:43,669 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-12 18:14:43,669 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:43,669 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 18:14:43,669 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:43,669 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:43,669 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 18:14:43,669 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 18:14:43,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 18:14:43,732 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 18:14:43,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 279 msec 2023-07-12 18:14:43,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 18:14:43,774 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 18:14:43,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 18:14:43,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 18:14:43,812 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 18:14:43,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 18:14:43,850 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=753 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-630721000_1 at /127.0.0.1:44838 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:44846 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1286 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:48840 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:40363 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-630721000_1 at /127.0.0.1:48820 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:56662 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:33351 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=917 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=371 (was 284) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=5216 (was 6923) 2023-07-12 18:14:43,851 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-12 18:14:43,872 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=371, ProcessCount=179, AvailableMemoryMB=5215 2023-07-12 18:14:43,872 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-12 18:14:43,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:43,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:43,880 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:43,881 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 18:14:43,882 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:43,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:43,886 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:43,886 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:43,887 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 empty. 2023-07-12 18:14:43,887 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 empty. 2023-07-12 18:14:43,887 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:43,887 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:43,887 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 18:14:43,920 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:43,923 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82f1f56f40b52e53db48a1985e2c0db4, NAME => 'testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:43,924 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0175f9f699fcbab986b67bdf4656e1d0, NAME => 'testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:43,956 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:43,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 82f1f56f40b52e53db48a1985e2c0db4, disabling compactions & flushes 2023-07-12 18:14:43,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:43,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:43,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. after waiting 0 ms 2023-07-12 18:14:43,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:43,957 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:43,957 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 82f1f56f40b52e53db48a1985e2c0db4: 2023-07-12 18:14:43,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:43,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 0175f9f699fcbab986b67bdf4656e1d0, disabling compactions & flushes 2023-07-12 18:14:43,959 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:43,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:43,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. after waiting 0 ms 2023-07-12 18:14:43,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:43,959 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:43,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 0175f9f699fcbab986b67bdf4656e1d0: 2023-07-12 18:14:43,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:43,964 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185683964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185683964"}]},"ts":"1689185683964"} 2023-07-12 18:14:43,964 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185683964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185683964"}]},"ts":"1689185683964"} 2023-07-12 18:14:43,967 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:14:43,968 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:43,968 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185683968"}]},"ts":"1689185683968"} 2023-07-12 18:14:43,970 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 18:14:43,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,146 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:44,148 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:44,148 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:44,148 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:44,148 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:44,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, ASSIGN}] 2023-07-12 18:14:44,152 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, ASSIGN 2023-07-12 18:14:44,152 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, ASSIGN 2023-07-12 18:14:44,153 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39547,1689185653208; forceNewPlan=false, retain=false 2023-07-12 18:14:44,153 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:14:44,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,303 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:14:44,307 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=82f1f56f40b52e53db48a1985e2c0db4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:44,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0175f9f699fcbab986b67bdf4656e1d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:44,307 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185684307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185684307"}]},"ts":"1689185684307"} 2023-07-12 18:14:44,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185684307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185684307"}]},"ts":"1689185684307"} 2023-07-12 18:14:44,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 82f1f56f40b52e53db48a1985e2c0db4, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:14:44,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 0175f9f699fcbab986b67bdf4656e1d0, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:14:44,467 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:44,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82f1f56f40b52e53db48a1985e2c0db4, NAME => 'testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:14:44,467 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. service=AccessControlService 2023-07-12 18:14:44,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:44,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:44,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,470 INFO [StoreOpener-82f1f56f40b52e53db48a1985e2c0db4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,472 DEBUG [StoreOpener-82f1f56f40b52e53db48a1985e2c0db4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf 2023-07-12 18:14:44,472 DEBUG [StoreOpener-82f1f56f40b52e53db48a1985e2c0db4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf 2023-07-12 18:14:44,473 INFO [StoreOpener-82f1f56f40b52e53db48a1985e2c0db4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82f1f56f40b52e53db48a1985e2c0db4 columnFamilyName cf 2023-07-12 18:14:44,473 INFO [StoreOpener-82f1f56f40b52e53db48a1985e2c0db4-1] regionserver.HStore(310): Store=82f1f56f40b52e53db48a1985e2c0db4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:44,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:44,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0175f9f699fcbab986b67bdf4656e1d0, NAME => 'testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:14:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. service=AccessControlService 2023-07-12 18:14:44,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:14:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,479 INFO [StoreOpener-0175f9f699fcbab986b67bdf4656e1d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,480 DEBUG [StoreOpener-0175f9f699fcbab986b67bdf4656e1d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf 2023-07-12 18:14:44,480 DEBUG [StoreOpener-0175f9f699fcbab986b67bdf4656e1d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf 2023-07-12 18:14:44,481 INFO [StoreOpener-0175f9f699fcbab986b67bdf4656e1d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0175f9f699fcbab986b67bdf4656e1d0 columnFamilyName cf 2023-07-12 18:14:44,481 INFO [StoreOpener-0175f9f699fcbab986b67bdf4656e1d0-1] regionserver.HStore(310): Store=0175f9f699fcbab986b67bdf4656e1d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:14:44,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:44,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:44,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:44,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82f1f56f40b52e53db48a1985e2c0db4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68877402, jitterRate=0.026353269815444946}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:44,488 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82f1f56f40b52e53db48a1985e2c0db4: 2023-07-12 18:14:44,489 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4., pid=30, masterSystemTime=1689185684463 2023-07-12 18:14:44,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:44,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:44,492 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=82f1f56f40b52e53db48a1985e2c0db4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:44,492 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684492"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185684492"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185684492"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185684492"}]},"ts":"1689185684492"} 2023-07-12 18:14:44,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 18:14:44,497 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 82f1f56f40b52e53db48a1985e2c0db4, server=jenkins-hbase4.apache.org,45233,1689185653260 in 185 msec 2023-07-12 18:14:44,499 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, ASSIGN in 349 msec 2023-07-12 18:14:44,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:14:44,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0175f9f699fcbab986b67bdf4656e1d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67511063, jitterRate=0.0059932321310043335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:14:44,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0175f9f699fcbab986b67bdf4656e1d0: 2023-07-12 18:14:44,503 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0., pid=31, masterSystemTime=1689185684471 2023-07-12 18:14:44,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:44,505 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:44,506 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=0175f9f699fcbab986b67bdf4656e1d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:44,506 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185684505"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185684505"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185684505"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185684505"}]},"ts":"1689185684505"} 2023-07-12 18:14:44,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 18:14:44,510 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 0175f9f699fcbab986b67bdf4656e1d0, server=jenkins-hbase4.apache.org,39547,1689185653208 in 195 msec 2023-07-12 18:14:44,513 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-12 18:14:44,515 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, ASSIGN in 362 msec 2023-07-12 18:14:44,516 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:14:44,516 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185684516"}]},"ts":"1689185684516"} 2023-07-12 18:14:44,522 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 18:14:44,555 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:14:44,555 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 18:14:44,558 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:14:44,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:44,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:14:44,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 816 msec 2023-07-12 18:14:44,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 18:14:44,992 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 18:14:44,992 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 18:14:44,992 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:44,996 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 18:14:44,996 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:44,996 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-12 18:14:45,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185685003 (current time:1689185685003). 2023-07-12 18:14:45,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:45,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x279703f6 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:45,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a94e114, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:45,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:45,018 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x279703f6 to 127.0.0.1:61297 2023-07-12 18:14:45,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:45,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x292a1ffe to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:45,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@363d319e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:45,039 DEBUG [hconnection-0x3bacea0c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:45,043 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55294, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x292a1ffe to 127.0.0.1:61297 2023-07-12 18:14:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:45,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:14:45,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:45,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,058 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,059 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186285059 2023-07-12 18:14:45,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,059 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 18:14:45,061 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:45,061 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:45,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,072 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 18 msec 2023-07-12 18:14:45,077 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,079 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186285079 2023-07-12 18:14:45,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,104 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 18:14:45,105 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,106 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 18:14:45,106 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:14:45,107 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,107 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,108 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,108 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,109 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,109 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,110 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 18:14:45,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,111 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,111 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,111 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,111 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 18:14:45,112 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:45,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 18:14:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,112 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,113 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,113 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,113 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,113 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,114 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,114 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,114 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,114 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,116 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,117 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,118 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,123 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,123 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,126 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,127 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,127 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:45,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59b5a61a[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:45,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59b5a61a[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:45,136 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:14:45,136 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,137 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,138 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,138 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,138 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:14:45,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:45,138 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:45,138 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:45,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,138 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. started... 2023-07-12 18:14:45,139 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,139 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,140 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,140 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:45,141 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,141 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,142 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,156 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:45,156 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:45,156 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:45,158 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. started... 2023-07-12 18:14:45,158 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82f1f56f40b52e53db48a1985e2c0db4: 2023-07-12 18:14:45,163 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,163 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,163 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:45,164 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:45,164 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0175f9f699fcbab986b67bdf4656e1d0: 2023-07-12 18:14:45,164 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,164 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:45,165 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:14:45,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:45,166 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:45,185 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. completed. 2023-07-12 18:14:45,186 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:14:45,186 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. completed. 2023-07-12 18:14:45,186 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,186 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,187 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:14:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,188 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,190 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,191 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:14:45,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:14:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:14:45,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:14:45,208 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 18:14:45,208 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:45,208 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:45,208 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,208 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:45,211 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,211 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,211 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,212 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,212 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,212 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,213 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,215 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,215 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,215 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,219 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,219 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,219 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,220 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,219 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,219 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,219 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,220 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,220 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,221 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,222 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,271 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 18:14:45,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,271 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:45,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689185685059Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689185685222 (+163 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689185685222Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689185685227 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689185685236 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689185685271 (+35 ms) 2023-07-12 18:14:45,274 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 213 msec 2023-07-12 18:14:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:45,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45233] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:45,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39547] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:14:45,388 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 18:14:45,388 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:45,388 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:14:45,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185685404 (current time:1689185685404). 2023-07-12 18:14:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:14:45,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x4eba902e to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:45,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f9f7cd8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:45,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:45,421 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:45,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eba902e to 127.0.0.1:61297 2023-07-12 18:14:45,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:45,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x139231e6 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:14:45,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d8e2c08, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:14:45,435 DEBUG [hconnection-0x4ab0569f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:14:45,436 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:14:45,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x139231e6 to 127.0.0.1:61297 2023-07-12 18:14:45,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:14:45,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:14:45,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:14:45,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,448 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,449 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186285449 2023-07-12 18:14:45,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:14:45,449 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 18:14:45,451 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:14:45,451 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:14:45,453 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:14:45,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,455 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-12 18:14:45,457 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,457 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186285457 2023-07-12 18:14:45,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 18:14:45,473 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 18:14:45,473 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,475 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 18:14:45,475 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:14:45,476 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,476 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,478 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,478 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,478 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,478 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,478 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,479 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,479 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,479 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,479 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,480 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,480 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,481 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 18:14:45,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,481 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,481 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 18:14:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,481 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,483 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,483 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,483 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,483 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,483 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 18:14:45,484 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,485 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,485 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:14:45,485 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,486 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 18:14:45,486 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 18:14:45,486 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 18:14:45,488 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,488 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,489 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,489 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:14:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:45,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39b1b800[Count = 1] remaining members to acquire global barrier 2023-07-12 18:14:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 18:14:45,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39b1b800[Count = 0] remaining members to acquire global barrier 2023-07-12 18:14:45,496 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:14:45,496 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,498 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,498 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,498 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:45,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,499 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:14:45,499 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. started... 2023-07-12 18:14:45,499 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,499 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:14:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:14:45,499 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. started... 2023-07-12 18:14:45,499 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:14:45,499 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0175f9f699fcbab986b67bdf4656e1d0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 18:14:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,499 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:14:45,499 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 82f1f56f40b52e53db48a1985e2c0db4 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 18:14:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,502 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,525 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/.tmp/cf/3f999afe969b46da97aff4860b5e802d 2023-07-12 18:14:45,527 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/.tmp/cf/0fba905702f54922ba6fb2e8b5113674 2023-07-12 18:14:45,538 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/.tmp/cf/3f999afe969b46da97aff4860b5e802d as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf/3f999afe969b46da97aff4860b5e802d 2023-07-12 18:14:45,540 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/.tmp/cf/0fba905702f54922ba6fb2e8b5113674 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf/0fba905702f54922ba6fb2e8b5113674 2023-07-12 18:14:45,551 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:14:45,556 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:14:45,557 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf/3f999afe969b46da97aff4860b5e802d, entries=47, sequenceid=6, filesize=8 K 2023-07-12 18:14:45,557 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf/0fba905702f54922ba6fb2e8b5113674, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 18:14:45,558 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 82f1f56f40b52e53db48a1985e2c0db4 in 59ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:45,558 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 0175f9f699fcbab986b67bdf4656e1d0 in 59ms, sequenceid=6, compaction requested=false 2023-07-12 18:14:45,558 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 18:14:45,558 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 18:14:45,561 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 82f1f56f40b52e53db48a1985e2c0db4: 2023-07-12 18:14:45,561 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0175f9f699fcbab986b67bdf4656e1d0: 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf/0fba905702f54922ba6fb2e8b5113674] hfiles 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf/3f999afe969b46da97aff4860b5e802d] hfiles 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf/0fba905702f54922ba6fb2e8b5113674 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,562 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf/3f999afe969b46da97aff4860b5e802d for snapshot=snaptb0-testExportFileSystemState 2023-07-12 18:14:45,585 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. completed. 2023-07-12 18:14:45,585 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:45,585 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:14:45,586 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. completed. 2023-07-12 18:14:45,586 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 18:14:45,586 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:14:45,591 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,591 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,591 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,591 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,592 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,593 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 18:14:45,593 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,593 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 18:14:45,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:14:45,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:14:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:14:45,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:14:45,601 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 18:14:45,601 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:14:45,601 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:14:45,601 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 18:14:45,601 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:14:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:14:45,603 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,604 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:14:45,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,604 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,605 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:14:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,616 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:14:45,616 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 18:14:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,617 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:14:45,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:14:45,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:14:45,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,631 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:14:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:14:45,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:14:45,633 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:14:45,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 18:14:45,633 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,633 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,633 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 18:14:45,633 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,643 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,709 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 18:14:45,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,709 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,710 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689185685449Consolidate snapshot: snaptb0-testExportFileSystemState at 1689185685633 (+184 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689185685633Writing data manifest for snaptb0-testExportFileSystemState at 1689185685650 (+17 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689185685665 (+15 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689185685709 (+44 ms) 2023-07-12 18:14:45,713 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 18:14:45,715 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 263 msec 2023-07-12 18:14:45,756 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:14:45,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:14:45,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:14:45,761 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761 2023-07-12 18:14:45,761 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43721, tgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761, rawTgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:45,787 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:14:45,787 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1265576371_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,787 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 18:14:45,799 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 18:14:45,831 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:45,831 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:45,832 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:45,832 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,804 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-4793075948292997890.jar 2023-07-12 18:14:46,805 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,805 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,876 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-6438502676632607627.jar 2023-07-12 18:14:46,876 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,877 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,877 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,878 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,878 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,878 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:14:46,879 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:14:46,879 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:14:46,880 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:14:46,880 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:14:46,880 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:14:46,881 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:14:46,881 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:14:46,882 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:14:46,882 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:14:46,883 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:14:46,883 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:46,884 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:46,884 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:46,885 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:46,885 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:14:46,886 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:46,887 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:14:47,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0001_000001 (auth:SIMPLE) 2023-07-12 18:14:48,011 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:14:48,014 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 18:14:48,017 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 18:14:48,097 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:48,097 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:14:48,331 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:48,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:14:53,153 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:55,373 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:58,173 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0002_000001 (auth:SIMPLE) 2023-07-12 18:14:59,220 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:14:59,223 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:14:59,233 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 18:14:59,233 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:14:59,234 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:14:59,234 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 18:14:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 18:14:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 18:14:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 18:14:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 18:14:59,235 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185685761/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 18:14:59,244 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 18:14:59,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-12 18:14:59,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 18:14:59,250 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185699249"}]},"ts":"1689185699249"} 2023-07-12 18:14:59,251 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 18:14:59,253 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 18:14:59,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, UNASSIGN}] 2023-07-12 18:14:59,257 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, UNASSIGN 2023-07-12 18:14:59,257 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, UNASSIGN 2023-07-12 18:14:59,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0175f9f699fcbab986b67bdf4656e1d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:59,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=82f1f56f40b52e53db48a1985e2c0db4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:14:59,258 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185699257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185699257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185699257"}]},"ts":"1689185699257"} 2023-07-12 18:14:59,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185699257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185699257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185699257"}]},"ts":"1689185699257"} 2023-07-12 18:14:59,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 0175f9f699fcbab986b67bdf4656e1d0, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:14:59,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 82f1f56f40b52e53db48a1985e2c0db4, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:14:59,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 18:14:59,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0175f9f699fcbab986b67bdf4656e1d0, disabling compactions & flushes 2023-07-12 18:14:59,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. after waiting 0 ms 2023-07-12 18:14:59,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:59,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82f1f56f40b52e53db48a1985e2c0db4, disabling compactions & flushes 2023-07-12 18:14:59,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. after waiting 0 ms 2023-07-12 18:14:59,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:59,430 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:14:59,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:14:59,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:59,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0. 2023-07-12 18:14:59,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0175f9f699fcbab986b67bdf4656e1d0: 2023-07-12 18:14:59,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:14:59,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4. 2023-07-12 18:14:59,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82f1f56f40b52e53db48a1985e2c0db4: 2023-07-12 18:14:59,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:59,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=0175f9f699fcbab986b67bdf4656e1d0, regionState=CLOSED 2023-07-12 18:14:59,436 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185699436"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185699436"}]},"ts":"1689185699436"} 2023-07-12 18:14:59,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:59,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=82f1f56f40b52e53db48a1985e2c0db4, regionState=CLOSED 2023-07-12 18:14:59,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689185699437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185699437"}]},"ts":"1689185699437"} 2023-07-12 18:14:59,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-12 18:14:59,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 0175f9f699fcbab986b67bdf4656e1d0, server=jenkins-hbase4.apache.org,39547,1689185653208 in 179 msec 2023-07-12 18:14:59,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-12 18:14:59,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 82f1f56f40b52e53db48a1985e2c0db4, server=jenkins-hbase4.apache.org,45233,1689185653260 in 179 msec 2023-07-12 18:14:59,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=0175f9f699fcbab986b67bdf4656e1d0, UNASSIGN in 186 msec 2023-07-12 18:14:59,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-12 18:14:59,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=82f1f56f40b52e53db48a1985e2c0db4, UNASSIGN in 187 msec 2023-07-12 18:14:59,444 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185699444"}]},"ts":"1689185699444"} 2023-07-12 18:14:59,445 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 18:14:59,447 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 18:14:59,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-07-12 18:14:59,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 18:14:59,552 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 18:14:59,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-12 18:14:59,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,557 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 18:14:59,559 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,560 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 18:14:59,564 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,564 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,564 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,565 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:59,566 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:14:59,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:14:59,566 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:14:59,569 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/recovered.edits] 2023-07-12 18:14:59,572 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 18:14:59,572 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:59,573 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,573 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,573 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:59,573 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:59,574 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,574 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:59,575 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 18:14:59,575 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:14:59,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 18:14:59,580 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/recovered.edits] 2023-07-12 18:14:59,590 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf/0fba905702f54922ba6fb2e8b5113674 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/cf/0fba905702f54922ba6fb2e8b5113674 2023-07-12 18:14:59,595 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4/recovered.edits/9.seqid 2023-07-12 18:14:59,596 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/82f1f56f40b52e53db48a1985e2c0db4 2023-07-12 18:14:59,604 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf/3f999afe969b46da97aff4860b5e802d to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/cf/3f999afe969b46da97aff4860b5e802d 2023-07-12 18:14:59,608 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0/recovered.edits/9.seqid 2023-07-12 18:14:59,610 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemState/0175f9f699fcbab986b67bdf4656e1d0 2023-07-12 18:14:59,611 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 18:14:59,614 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,618 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 18:14:59,620 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 18:14:59,622 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,622 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 18:14:59,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185699622"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:59,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185699622"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:59,633 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:14:59,633 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 82f1f56f40b52e53db48a1985e2c0db4, NAME => 'testtb-testExportFileSystemState,,1689185683874.82f1f56f40b52e53db48a1985e2c0db4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0175f9f699fcbab986b67bdf4656e1d0, NAME => 'testtb-testExportFileSystemState,1,1689185683874.0175f9f699fcbab986b67bdf4656e1d0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:14:59,633 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 18:14:59,633 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185699633"}]},"ts":"9223372036854775807"} 2023-07-12 18:14:59,636 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 18:14:59,639 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 18:14:59,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 86 msec 2023-07-12 18:14:59,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 18:14:59,678 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 18:14:59,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 18:14:59,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 18:14:59,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 18:14:59,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 18:14:59,725 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=763 (was 753) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1952 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:35772 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2119670494_1 at /127.0.0.1:47588 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:44727 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:45231 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:47602 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1265576371_17 at /127.0.0.1:46086 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=317 (was 371), ProcessCount=179 (was 179), AvailableMemoryMB=4903 (was 5215) 2023-07-12 18:14:59,725 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 18:14:59,746 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=317, ProcessCount=179, AvailableMemoryMB=4903 2023-07-12 18:14:59,747 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 18:14:59,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:14:59,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:14:59,752 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:14:59,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 18:14:59,753 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:14:59,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:14:59,756 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:14:59,756 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:14:59,756 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 empty. 2023-07-12 18:14:59,756 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a empty. 2023-07-12 18:14:59,757 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:14:59,757 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:14:59,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 18:14:59,774 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 18:14:59,775 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6b92618190ea0f160e02a7830e3103e2, NAME => 'testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:59,776 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => b5e2ff0402b286b5320b26e0a8602b4a, NAME => 'testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing b5e2ff0402b286b5320b26e0a8602b4a, disabling compactions & flushes 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 6b92618190ea0f160e02a7830e3103e2, disabling compactions & flushes 2023-07-12 18:14:59,799 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:14:59,799 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. after waiting 0 ms 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. after waiting 0 ms 2023-07-12 18:14:59,799 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:14:59,799 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for b5e2ff0402b286b5320b26e0a8602b4a: 2023-07-12 18:14:59,799 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:14:59,800 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 6b92618190ea0f160e02a7830e3103e2: 2023-07-12 18:14:59,803 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:14:59,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185699804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185699804"}]},"ts":"1689185699804"} 2023-07-12 18:14:59,804 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185699804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185699804"}]},"ts":"1689185699804"} 2023-07-12 18:14:59,807 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:14:59,808 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:14:59,808 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185699808"}]},"ts":"1689185699808"} 2023-07-12 18:14:59,810 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 18:14:59,815 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:14:59,817 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:14:59,817 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:14:59,817 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:14:59,817 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:14:59,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, ASSIGN}] 2023-07-12 18:14:59,824 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, ASSIGN 2023-07-12 18:14:59,824 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, ASSIGN 2023-07-12 18:14:59,825 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41341,1689185653145; forceNewPlan=false, retain=false 2023-07-12 18:14:59,825 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39547,1689185653208; forceNewPlan=false, retain=false 2023-07-12 18:14:59,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:14:59,975 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:14:59,978 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6b92618190ea0f160e02a7830e3103e2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:14:59,978 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b5e2ff0402b286b5320b26e0a8602b4a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:14:59,978 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185699978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185699978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185699978"}]},"ts":"1689185699978"} 2023-07-12 18:14:59,978 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185699978"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185699978"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185699978"}]},"ts":"1689185699978"} 2023-07-12 18:14:59,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 6b92618190ea0f160e02a7830e3103e2, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:14:59,981 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure b5e2ff0402b286b5320b26e0a8602b4a, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:15:00,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6b92618190ea0f160e02a7830e3103e2, NAME => 'testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:15:00,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b5e2ff0402b286b5320b26e0a8602b4a, NAME => 'testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. service=AccessControlService 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. service=AccessControlService 2023-07-12 18:15:00,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:00,142 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,145 INFO [StoreOpener-6b92618190ea0f160e02a7830e3103e2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,145 INFO [StoreOpener-b5e2ff0402b286b5320b26e0a8602b4a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,146 DEBUG [StoreOpener-6b92618190ea0f160e02a7830e3103e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf 2023-07-12 18:15:00,146 DEBUG [StoreOpener-6b92618190ea0f160e02a7830e3103e2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf 2023-07-12 18:15:00,147 DEBUG [StoreOpener-b5e2ff0402b286b5320b26e0a8602b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf 2023-07-12 18:15:00,147 DEBUG [StoreOpener-b5e2ff0402b286b5320b26e0a8602b4a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf 2023-07-12 18:15:00,147 INFO [StoreOpener-b5e2ff0402b286b5320b26e0a8602b4a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b5e2ff0402b286b5320b26e0a8602b4a columnFamilyName cf 2023-07-12 18:15:00,147 INFO [StoreOpener-6b92618190ea0f160e02a7830e3103e2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b92618190ea0f160e02a7830e3103e2 columnFamilyName cf 2023-07-12 18:15:00,148 INFO [StoreOpener-b5e2ff0402b286b5320b26e0a8602b4a-1] regionserver.HStore(310): Store=b5e2ff0402b286b5320b26e0a8602b4a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:00,148 INFO [StoreOpener-6b92618190ea0f160e02a7830e3103e2-1] regionserver.HStore(310): Store=6b92618190ea0f160e02a7830e3103e2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:00,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:00,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:00,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:00,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:00,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6b92618190ea0f160e02a7830e3103e2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58739400, jitterRate=-0.12471473217010498}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:00,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6b92618190ea0f160e02a7830e3103e2: 2023-07-12 18:15:00,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b5e2ff0402b286b5320b26e0a8602b4a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64824908, jitterRate=-0.03403359651565552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:00,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b5e2ff0402b286b5320b26e0a8602b4a: 2023-07-12 18:15:00,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2., pid=45, masterSystemTime=1689185700132 2023-07-12 18:15:00,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a., pid=46, masterSystemTime=1689185700133 2023-07-12 18:15:00,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,160 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=6b92618190ea0f160e02a7830e3103e2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185700161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185700161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185700161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185700161"}]},"ts":"1689185700161"} 2023-07-12 18:15:00,162 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=b5e2ff0402b286b5320b26e0a8602b4a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,162 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185700161"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185700161"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185700161"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185700161"}]},"ts":"1689185700161"} 2023-07-12 18:15:00,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-12 18:15:00,166 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 6b92618190ea0f160e02a7830e3103e2, server=jenkins-hbase4.apache.org,41341,1689185653145 in 183 msec 2023-07-12 18:15:00,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-12 18:15:00,168 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure b5e2ff0402b286b5320b26e0a8602b4a, server=jenkins-hbase4.apache.org,39547,1689185653208 in 184 msec 2023-07-12 18:15:00,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, ASSIGN in 350 msec 2023-07-12 18:15:00,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-12 18:15:00,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, ASSIGN in 351 msec 2023-07-12 18:15:00,171 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:00,171 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185700171"}]},"ts":"1689185700171"} 2023-07-12 18:15:00,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 18:15:00,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:00,176 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 18:15:00,178 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 18:15:00,179 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:00,179 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:00,179 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:00,179 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:00,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:00,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:00,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:00,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:00,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 433 msec 2023-07-12 18:15:00,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 18:15:00,358 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 18:15:00,358 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-12 18:15:00,358 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:00,361 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-12 18:15:00,361 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:00,361 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-12 18:15:00,364 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:00,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185700364 (current time:1689185700364). 2023-07-12 18:15:00,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:00,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x17566d12 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:00,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ef750a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:00,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:00,376 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42126, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:00,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17566d12 to 127.0.0.1:61297 2023-07-12 18:15:00,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:00,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x20dabbaa to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:00,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4406c5e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:00,384 DEBUG [hconnection-0x360667-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:00,387 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:00,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x20dabbaa to 127.0.0.1:61297 2023-07-12 18:15:00,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:00,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 18:15:00,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:00,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:00,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:00,396 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:00,397 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689186300397 2023-07-12 18:15:00,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:00,397 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 18:15:00,398 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:00,398 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:00,399 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:00,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:00,400 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 18:15:00,401 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:00,401 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689186300401 2023-07-12 18:15:00,415 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,415 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 18:15:00,415 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,417 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 18:15:00,417 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 18:15:00,417 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,417 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,419 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,419 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,419 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,419 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,420 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,420 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,420 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,420 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 18:15:00,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,421 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,422 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:00,423 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:00,423 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:00,421 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,423 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:00,423 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:00,426 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:00,426 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:00,426 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:00,426 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,428 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:00,428 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:00,428 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b214445[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:00,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b214445[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:00,433 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 18:15:00,433 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,434 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,434 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:00,435 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:00,435 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,435 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. started... 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:15:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:00,435 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,436 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:00,436 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6b92618190ea0f160e02a7830e3103e2: 2023-07-12 18:15:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:00,436 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,436 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. started... 2023-07-12 18:15:00,436 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,436 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:00,437 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:00,437 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5e2ff0402b286b5320b26e0a8602b4a: 2023-07-12 18:15:00,437 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,438 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:00,438 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,442 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:00,451 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. completed. 2023-07-12 18:15:00,451 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,451 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:00,451 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:00,451 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,451 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:00,451 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:15:00,452 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:00,453 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,453 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,453 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:00,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,454 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. completed. 2023-07-12 18:15:00,454 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,454 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:00,454 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:00,454 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:00,455 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:15:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,456 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:00,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,456 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,456 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,456 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:15:00,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 18:15:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41341,1689185653145': 2023-07-12 18:15:00,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 18:15:00,462 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 18:15:00,462 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:00,462 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:00,462 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,463 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,465 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,464 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,465 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,466 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,468 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,468 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,469 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,472 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,473 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,473 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,473 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,475 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,475 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,475 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,475 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,475 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,475 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,494 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,498 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:00,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:00,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:00,499 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:00,521 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 18:15:00,521 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,521 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:00,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689185700397Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689185700473 (+76 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689185700473Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689185700478 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689185700488 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689185700521 (+33 ms) 2023-07-12 18:15:00,524 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:00,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 126 msec 2023-07-12 18:15:00,700 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:00,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:00,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:00,708 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:00,711 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:00,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39547] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:00,712 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41341] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:00,715 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 18:15:00,716 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,717 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:00,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:00,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185700729 (current time:1689185700729). 2023-07-12 18:15:00,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:00,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x4cd3dc15 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:00,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23a2e80f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:00,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:00,745 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:00,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cd3dc15 to 127.0.0.1:61297 2023-07-12 18:15:00,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:00,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x3aa5e3c8 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:00,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6844a3fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:00,754 DEBUG [hconnection-0x5c92cc6a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:00,757 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42150, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:00,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3aa5e3c8 to 127.0.0.1:61297 2023-07-12 18:15:00,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:00,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 18:15:00,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:00,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:00,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:00,765 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:00,766 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689186300766 2023-07-12 18:15:00,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 18:15:00,766 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 18:15:00,767 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:00,767 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:00,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:00,768 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 18:15:00,770 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 18:15:00,771 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:00,771 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689186300771 2023-07-12 18:15:00,785 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 18:15:00,785 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 18:15:00,785 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,787 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 18:15:00,787 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 18:15:00,787 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,787 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,788 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,788 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,788 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,788 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,789 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,789 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,789 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,789 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 18:15:00,791 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:00,791 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:00,791 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,793 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:00,793 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:00,793 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 18:15:00,791 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,793 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:00,794 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:00,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 18:15:00,794 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:00,794 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 18:15:00,794 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:00,794 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:00,795 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 18:15:00,795 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 18:15:00,795 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 18:15:00,797 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,798 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,798 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,798 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:00,798 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,801 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,801 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,801 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,801 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,802 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39397200[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 18:15:00,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39397200[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:00,806 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 18:15:00,806 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:00,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:00,807 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 18:15:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:00,808 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,808 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,808 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. started... 2023-07-12 18:15:00,808 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,808 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:00,807 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:00,808 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. started... 2023-07-12 18:15:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:00,808 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:15:00,808 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b5e2ff0402b286b5320b26e0a8602b4a 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 18:15:00,808 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6b92618190ea0f160e02a7830e3103e2 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 18:15:00,810 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:00,810 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,810 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:00,829 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/.tmp/cf/e4259ab41aeb40268685aedd4c12a38f 2023-07-12 18:15:00,830 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/.tmp/cf/8752060b4e5445498dbabffbf7bd9807 2023-07-12 18:15:00,835 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/.tmp/cf/e4259ab41aeb40268685aedd4c12a38f as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf/e4259ab41aeb40268685aedd4c12a38f 2023-07-12 18:15:00,836 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/.tmp/cf/8752060b4e5445498dbabffbf7bd9807 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf/8752060b4e5445498dbabffbf7bd9807 2023-07-12 18:15:00,841 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf/e4259ab41aeb40268685aedd4c12a38f, entries=3, sequenceid=6, filesize=5.0 K 2023-07-12 18:15:00,842 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf/8752060b4e5445498dbabffbf7bd9807, entries=47, sequenceid=6, filesize=8.0 K 2023-07-12 18:15:00,842 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 6b92618190ea0f160e02a7830e3103e2 in 34ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:00,843 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 18:15:00,843 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b5e2ff0402b286b5320b26e0a8602b4a in 35ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:00,843 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6b92618190ea0f160e02a7830e3103e2: 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b5e2ff0402b286b5320b26e0a8602b4a: 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf/e4259ab41aeb40268685aedd4c12a38f] hfiles 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf/8752060b4e5445498dbabffbf7bd9807] hfiles 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf/e4259ab41aeb40268685aedd4c12a38f for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:00,845 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf/8752060b4e5445498dbabffbf7bd9807 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 18:15:00,866 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. completed. 2023-07-12 18:15:00,866 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. completed. 2023-07-12 18:15:00,866 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:00,866 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:15:00,866 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:15:00,867 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:00,868 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,868 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,868 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:00,868 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 18:15:00,868 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,868 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:00,868 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:00,870 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 18:15:00,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:00,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,871 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,41341,1689185653145': 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:15:00,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 18:15:00,878 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 18:15:00,878 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:00,878 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:00,878 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 18:15:00,878 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:00,880 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,880 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,880 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:00,881 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,881 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,882 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,882 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:00,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:00,885 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 18:15:00,885 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,885 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,892 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 18:15:00,892 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 18:15:00,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,892 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,892 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:00,892 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,891 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:00,892 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:00,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:00,892 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,894 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:00,894 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,894 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:00,894 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:00,894 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,894 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,892 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:00,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:00,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,942 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 18:15:00,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,943 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:00,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689185700766Consolidate snapshot: snaptb0-testConsecutiveExports at 1689185700892 (+126 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689185700892Writing data manifest for snaptb0-testConsecutiveExports at 1689185700897 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689185700911 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689185700942 (+31 ms) 2023-07-12 18:15:00,945 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 18:15:00,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 178 msec 2023-07-12 18:15:01,071 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:01,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 18:15:01,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:01,073 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073 2023-07-12 18:15:01,073 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:15:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:15:01,102 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@781fe3d3, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:01,102 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 18:15:01,133 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:01,152 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:01,153 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:01,153 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:01,154 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,114 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-4543622243434193136.jar 2023-07-12 18:15:02,114 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,114 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,181 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-3822308017369284771.jar 2023-07-12 18:15:02,182 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,182 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,182 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,183 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,183 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,183 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:02,184 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:15:02,184 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:15:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:15:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:15:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:15:02,186 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:15:02,186 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:15:02,186 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:15:02,187 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:15:02,187 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:15:02,188 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:02,188 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:02,189 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:02,189 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:02,189 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:02,190 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:02,190 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:03,154 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:15:03,157 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 18:15:03,160 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 18:15:04,283 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:04,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:04,287 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0002_000001 (auth:SIMPLE) 2023-07-12 18:15:05,035 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:15:05,119 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:09,430 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:11,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:14,223 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:15,349 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:15:15,349 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:15:15,353 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 18:15:15,353 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:15:15,354 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:15:15,354 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:15,356 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:15,356 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:15,356 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@22ac2a21 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:15,357 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:15,357 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:15,358 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:15:15,381 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:15:15,382 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@67f7cdcd, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:15,382 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 18:15:15,392 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 18:15:15,411 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:15,411 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:15,412 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:15,412 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,371 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-8194462573620872632.jar 2023-07-12 18:15:16,372 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,372 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,439 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-8944039101744148951.jar 2023-07-12 18:15:16,439 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,440 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,440 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,441 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,442 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,442 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:16,443 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:15:16,443 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:15:16,444 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:15:16,444 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:15:16,444 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:15:16,445 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:15:16,445 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:15:16,445 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:15:16,446 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:15:16,446 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:15:16,447 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:16,447 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:16,448 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:16,448 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:16,448 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:16,449 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:16,833 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:15:16,836 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 18:15:16,838 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 18:15:20,398 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:20,398 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:20,402 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0003_000001 (auth:SIMPLE) 2023-07-12 18:15:21,299 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:26,192 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:28,673 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:34,043 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:15:34,044 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:15:34,047 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 18:15:34,047 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:15:34,047 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:15:34,047 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:34,051 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:34,051 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:34,051 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@22ac2a21 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 18:15:34,052 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 18:15:34,052 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/local-export-1689185701073/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 18:15:34,065 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 18:15:34,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-12 18:15:34,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185734071"}]},"ts":"1689185734071"} 2023-07-12 18:15:34,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 18:15:34,075 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 18:15:34,076 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 18:15:34,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, UNASSIGN}] 2023-07-12 18:15:34,080 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, UNASSIGN 2023-07-12 18:15:34,081 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, UNASSIGN 2023-07-12 18:15:34,082 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b5e2ff0402b286b5320b26e0a8602b4a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:34,082 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185734082"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185734082"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185734082"}]},"ts":"1689185734082"} 2023-07-12 18:15:34,082 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6b92618190ea0f160e02a7830e3103e2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:34,083 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185734082"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185734082"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185734082"}]},"ts":"1689185734082"} 2023-07-12 18:15:34,092 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure b5e2ff0402b286b5320b26e0a8602b4a, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:34,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 6b92618190ea0f160e02a7830e3103e2, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:15:34,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 18:15:34,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:34,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b5e2ff0402b286b5320b26e0a8602b4a, disabling compactions & flushes 2023-07-12 18:15:34,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:34,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:34,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. after waiting 0 ms 2023-07-12 18:15:34,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:34,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:34,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6b92618190ea0f160e02a7830e3103e2, disabling compactions & flushes 2023-07-12 18:15:34,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:34,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:34,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. after waiting 0 ms 2023-07-12 18:15:34,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:34,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:34,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:34,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:34,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2. 2023-07-12 18:15:34,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6b92618190ea0f160e02a7830e3103e2: 2023-07-12 18:15:34,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:34,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a. 2023-07-12 18:15:34,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b5e2ff0402b286b5320b26e0a8602b4a: 2023-07-12 18:15:34,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:34,301 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=6b92618190ea0f160e02a7830e3103e2, regionState=CLOSED 2023-07-12 18:15:34,301 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185734301"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185734301"}]},"ts":"1689185734301"} 2023-07-12 18:15:34,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:34,303 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=b5e2ff0402b286b5320b26e0a8602b4a, regionState=CLOSED 2023-07-12 18:15:34,303 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689185734303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185734303"}]},"ts":"1689185734303"} 2023-07-12 18:15:34,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-12 18:15:34,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 6b92618190ea0f160e02a7830e3103e2, server=jenkins-hbase4.apache.org,41341,1689185653145 in 208 msec 2023-07-12 18:15:34,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-12 18:15:34,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure b5e2ff0402b286b5320b26e0a8602b4a, server=jenkins-hbase4.apache.org,39547,1689185653208 in 218 msec 2023-07-12 18:15:34,313 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=6b92618190ea0f160e02a7830e3103e2, UNASSIGN in 234 msec 2023-07-12 18:15:34,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 18:15:34,319 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=b5e2ff0402b286b5320b26e0a8602b4a, UNASSIGN in 236 msec 2023-07-12 18:15:34,320 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185734320"}]},"ts":"1689185734320"} 2023-07-12 18:15:34,321 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 18:15:34,323 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 18:15:34,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 259 msec 2023-07-12 18:15:34,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 18:15:34,376 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 18:15:34,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-12 18:15:34,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,381 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 18:15:34,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,385 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 18:15:34,390 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:34,391 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,391 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,391 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,391 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 18:15:34,391 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 18:15:34,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 18:15:34,392 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 18:15:34,393 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:34,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 18:15:34,395 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:34,399 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/recovered.edits] 2023-07-12 18:15:34,405 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/recovered.edits] 2023-07-12 18:15:34,411 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf/e4259ab41aeb40268685aedd4c12a38f to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/cf/e4259ab41aeb40268685aedd4c12a38f 2023-07-12 18:15:34,412 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf/8752060b4e5445498dbabffbf7bd9807 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/cf/8752060b4e5445498dbabffbf7bd9807 2023-07-12 18:15:34,416 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2/recovered.edits/9.seqid 2023-07-12 18:15:34,416 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a/recovered.edits/9.seqid 2023-07-12 18:15:34,416 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/6b92618190ea0f160e02a7830e3103e2 2023-07-12 18:15:34,417 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testConsecutiveExports/b5e2ff0402b286b5320b26e0a8602b4a 2023-07-12 18:15:34,417 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 18:15:34,419 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,423 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 18:15:34,433 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 18:15:34,435 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,435 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 18:15:34,436 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185734435"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:34,436 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185734435"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:34,440 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:15:34,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6b92618190ea0f160e02a7830e3103e2, NAME => 'testtb-testConsecutiveExports,,1689185699748.6b92618190ea0f160e02a7830e3103e2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b5e2ff0402b286b5320b26e0a8602b4a, NAME => 'testtb-testConsecutiveExports,1,1689185699748.b5e2ff0402b286b5320b26e0a8602b4a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:15:34,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 18:15:34,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185734440"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:34,445 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 18:15:34,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 18:15:34,455 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 74 msec 2023-07-12 18:15:34,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 18:15:34,496 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 18:15:34,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 18:15:34,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 18:15:34,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 18:15:34,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 18:15:34,543 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=746 (was 763), OpenFileDescriptor=885 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=385 (was 317) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=4262 (was 4903) 2023-07-12 18:15:34,543 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-12 18:15:34,573 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=885, MaxFileDescriptor=60000, SystemLoadAverage=385, ProcessCount=182, AvailableMemoryMB=4245 2023-07-12 18:15:34,574 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-12 18:15:34,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:15:34,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:34,590 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:15:34,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 18:15:34,591 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:15:34,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:34,596 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:34,596 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:34,599 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c empty. 2023-07-12 18:15:34,599 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce empty. 2023-07-12 18:15:34,600 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:34,600 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:34,600 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 18:15:34,637 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 18:15:34,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 639bb5f408358c6cc4ef294848966fce, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:15:34,641 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0ce4389dd8caaad3d34bd3c1b6654e5c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:15:34,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 639bb5f408358c6cc4ef294848966fce, disabling compactions & flushes 2023-07-12 18:15:34,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. after waiting 0 ms 2023-07-12 18:15:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:34,743 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:34,743 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 639bb5f408358c6cc4ef294848966fce: 2023-07-12 18:15:34,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:34,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 0ce4389dd8caaad3d34bd3c1b6654e5c, disabling compactions & flushes 2023-07-12 18:15:34,744 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:34,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:34,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. after waiting 0 ms 2023-07-12 18:15:34,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:34,744 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:34,744 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 0ce4389dd8caaad3d34bd3c1b6654e5c: 2023-07-12 18:15:34,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:15:34,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185734747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185734747"}]},"ts":"1689185734747"} 2023-07-12 18:15:34,748 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185734747"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185734747"}]},"ts":"1689185734747"} 2023-07-12 18:15:34,756 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:15:34,758 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:15:34,758 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185734758"}]},"ts":"1689185734758"} 2023-07-12 18:15:34,760 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 18:15:34,774 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:15:34,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:15:34,776 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:15:34,777 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:15:34,777 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:15:34,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, ASSIGN}] 2023-07-12 18:15:34,781 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, ASSIGN 2023-07-12 18:15:34,781 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, ASSIGN 2023-07-12 18:15:34,782 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41341,1689185653145; forceNewPlan=false, retain=false 2023-07-12 18:15:34,782 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:15:34,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:34,932 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:15:34,935 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0ce4389dd8caaad3d34bd3c1b6654e5c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:34,935 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=639bb5f408358c6cc4ef294848966fce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:34,935 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185734935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185734935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185734935"}]},"ts":"1689185734935"} 2023-07-12 18:15:34,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185734935"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185734935"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185734935"}]},"ts":"1689185734935"} 2023-07-12 18:15:34,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 0ce4389dd8caaad3d34bd3c1b6654e5c, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:15:34,939 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 639bb5f408358c6cc4ef294848966fce, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:15:35,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 639bb5f408358c6cc4ef294848966fce, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:15:35,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ce4389dd8caaad3d34bd3c1b6654e5c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. service=AccessControlService 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. service=AccessControlService 2023-07-12 18:15:35,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:35,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,099 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,100 INFO [StoreOpener-639bb5f408358c6cc4ef294848966fce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,100 INFO [StoreOpener-0ce4389dd8caaad3d34bd3c1b6654e5c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,102 DEBUG [StoreOpener-639bb5f408358c6cc4ef294848966fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf 2023-07-12 18:15:35,102 DEBUG [StoreOpener-639bb5f408358c6cc4ef294848966fce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf 2023-07-12 18:15:35,102 DEBUG [StoreOpener-0ce4389dd8caaad3d34bd3c1b6654e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf 2023-07-12 18:15:35,102 DEBUG [StoreOpener-0ce4389dd8caaad3d34bd3c1b6654e5c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf 2023-07-12 18:15:35,104 INFO [StoreOpener-639bb5f408358c6cc4ef294848966fce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 639bb5f408358c6cc4ef294848966fce columnFamilyName cf 2023-07-12 18:15:35,104 INFO [StoreOpener-0ce4389dd8caaad3d34bd3c1b6654e5c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ce4389dd8caaad3d34bd3c1b6654e5c columnFamilyName cf 2023-07-12 18:15:35,106 INFO [StoreOpener-639bb5f408358c6cc4ef294848966fce-1] regionserver.HStore(310): Store=639bb5f408358c6cc4ef294848966fce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:35,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,108 INFO [StoreOpener-0ce4389dd8caaad3d34bd3c1b6654e5c-1] regionserver.HStore(310): Store=0ce4389dd8caaad3d34bd3c1b6654e5c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:35,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:35,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 639bb5f408358c6cc4ef294848966fce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73860325, jitterRate=0.10060460865497589}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:35,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 639bb5f408358c6cc4ef294848966fce: 2023-07-12 18:15:35,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ce4389dd8caaad3d34bd3c1b6654e5c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70062275, jitterRate=0.0440092533826828}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:35,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ce4389dd8caaad3d34bd3c1b6654e5c: 2023-07-12 18:15:35,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c., pid=60, masterSystemTime=1689185735090 2023-07-12 18:15:35,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,120 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=0ce4389dd8caaad3d34bd3c1b6654e5c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,120 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185735120"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185735120"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185735120"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185735120"}]},"ts":"1689185735120"} 2023-07-12 18:15:35,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 18:15:35,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 0ce4389dd8caaad3d34bd3c1b6654e5c, server=jenkins-hbase4.apache.org,45233,1689185653260 in 184 msec 2023-07-12 18:15:35,125 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, ASSIGN in 347 msec 2023-07-12 18:15:35,127 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce., pid=61, masterSystemTime=1689185735090 2023-07-12 18:15:35,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,128 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=639bb5f408358c6cc4ef294848966fce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,129 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185735128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185735128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185735128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185735128"}]},"ts":"1689185735128"} 2023-07-12 18:15:35,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 18:15:35,132 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 639bb5f408358c6cc4ef294848966fce, server=jenkins-hbase4.apache.org,41341,1689185653145 in 191 msec 2023-07-12 18:15:35,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 18:15:35,134 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, ASSIGN in 355 msec 2023-07-12 18:15:35,135 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:35,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185735135"}]},"ts":"1689185735135"} 2023-07-12 18:15:35,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 18:15:35,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:35,139 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 18:15:35,141 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 18:15:35,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:35,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:35,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:35,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:35,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:35,145 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:35,145 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:35,145 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:35,146 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 568 msec 2023-07-12 18:15:35,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 18:15:35,199 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 18:15:35,199 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-12 18:15:35,199 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:35,202 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-12 18:15:35,203 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:35,203 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-12 18:15:35,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:35,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185735206 (current time:1689185735206). 2023-07-12 18:15:35,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:35,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x35d4a5ba to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:35,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f018a51, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:35,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:35,219 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:35,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35d4a5ba to 127.0.0.1:61297 2023-07-12 18:15:35,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:35,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x61a2c678 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:35,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@714b4683, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:35,238 DEBUG [hconnection-0x32db19f9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:35,240 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:35,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61a2c678 to 127.0.0.1:61297 2023-07-12 18:15:35,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:35,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 18:15:35,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:35,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:35,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:35,252 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:35,253 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689186335253 2023-07-12 18:15:35,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,254 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:35,254 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:35,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:35,256 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:35,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-12 18:15:35,260 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:35,261 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689186335261 2023-07-12 18:15:35,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,282 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 18:15:35,282 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,283 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 18:15:35,283 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 18:15:35,283 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,283 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,291 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,291 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,291 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,291 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,291 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,291 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,291 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,292 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 18:15:35,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 18:15:35,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:35,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:35,293 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:35,293 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,293 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:35,293 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,296 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,296 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:35,296 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:35,296 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:35,296 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:35,296 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,296 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:35,298 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:35,298 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,298 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:35,299 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:35,299 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:35,299 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:35,299 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:35,300 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,301 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,301 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,301 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,301 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:35,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,302 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,302 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,302 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,302 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:35,302 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,302 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:35,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc8964b[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:35,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dc8964b[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:35,310 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 18:15:35,310 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:35,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:15:35,314 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:35,315 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,315 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,315 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:35,318 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:35,318 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:35,318 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. started... 2023-07-12 18:15:35,318 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,319 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. started... 2023-07-12 18:15:35,321 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 639bb5f408358c6cc4ef294848966fce: 2023-07-12 18:15:35,322 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ce4389dd8caaad3d34bd3c1b6654e5c: 2023-07-12 18:15:35,324 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,324 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:35,324 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:35,324 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:35,324 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,324 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:35,324 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:35,354 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:35,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:35,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:35,356 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:35,374 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. completed. 2023-07-12 18:15:35,374 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:35,374 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. completed. 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:35,374 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,374 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:15:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:35,375 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:15:35,376 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:35,376 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,376 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,376 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,377 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,377 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,378 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:35,377 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:15:35,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 18:15:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41341,1689185653145': 2023-07-12 18:15:35,386 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 18:15:35,386 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 18:15:35,386 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:35,386 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:35,386 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,386 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:35,388 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,388 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,388 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,388 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,388 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,388 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,388 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,389 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,389 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,389 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,390 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,392 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,392 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,393 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,396 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,396 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,398 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,398 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,398 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,399 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,452 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 18:15:35,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,453 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689185735253Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185735399 (+146 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185735399Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185735404 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689185735414 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689185735452 (+38 ms) 2023-07-12 18:15:35,455 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:35,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 201 msec 2023-07-12 18:15:35,556 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:35,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:35,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:35,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41341] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:35,576 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45233] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:15:35,584 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,585 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,585 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:35,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:35,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185735603 (current time:1689185735603). 2023-07-12 18:15:35,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:35,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x4b618c2c to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:35,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5975361d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:35,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:35,619 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b618c2c to 127.0.0.1:61297 2023-07-12 18:15:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:35,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x532f6c27 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:35,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14e89a82, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:35,635 DEBUG [hconnection-0x64dd83dc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:35,638 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:35,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x532f6c27 to 127.0.0.1:61297 2023-07-12 18:15:35,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:35,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 18:15:35,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:35,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:35,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:35,647 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:35,648 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689186335648 2023-07-12 18:15:35,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 18:15:35,648 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,649 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:35,649 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:35,650 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 18:15:35,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:35,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-07-12 18:15:35,652 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:35,653 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689186335653 2023-07-12 18:15:35,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,667 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 18:15:35,667 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,669 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 18:15:35,669 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 18:15:35,669 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,669 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,672 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,672 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,672 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,672 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,672 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,672 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,673 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,673 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:35,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,673 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:35,674 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 18:15:35,678 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,679 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:35,679 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,681 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,683 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:35,683 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:35,683 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,683 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:35,683 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:35,683 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 18:15:35,685 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 18:15:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 18:15:35,686 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 18:15:35,689 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:35,690 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:35,690 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,690 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:35,696 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@798d464a[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:35,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 18:15:35,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@798d464a[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:35,700 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 18:15:35,700 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,702 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:35,702 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:35,702 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:15:35,702 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,702 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:35,702 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 18:15:35,703 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,703 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. started... 2023-07-12 18:15:35,702 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:35,703 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:35,703 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:35,703 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:35,703 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,703 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. started... 2023-07-12 18:15:35,703 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 639bb5f408358c6cc4ef294848966fce 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-12 18:15:35,703 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0ce4389dd8caaad3d34bd3c1b6654e5c 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-12 18:15:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,705 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:35,735 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/.tmp/cf/e4bf980338874e12b1ba4f65a0880b59 2023-07-12 18:15:35,737 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/.tmp/cf/0013e55a063746edbba703f274abc606 2023-07-12 18:15:35,748 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/.tmp/cf/e4bf980338874e12b1ba4f65a0880b59 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf/e4bf980338874e12b1ba4f65a0880b59 2023-07-12 18:15:35,749 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:35,751 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:35,754 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf/e4bf980338874e12b1ba4f65a0880b59, entries=6, sequenceid=6, filesize=5.2 K 2023-07-12 18:15:35,756 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/.tmp/cf/0013e55a063746edbba703f274abc606 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf/0013e55a063746edbba703f274abc606 2023-07-12 18:15:35,756 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 639bb5f408358c6cc4ef294848966fce in 53ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:35,756 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 18:15:35,757 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 639bb5f408358c6cc4ef294848966fce: 2023-07-12 18:15:35,757 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,757 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:35,757 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf/e4bf980338874e12b1ba4f65a0880b59] hfiles 2023-07-12 18:15:35,757 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf/e4bf980338874e12b1ba4f65a0880b59 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,761 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf/0013e55a063746edbba703f274abc606, entries=44, sequenceid=6, filesize=7.8 K 2023-07-12 18:15:35,762 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 0ce4389dd8caaad3d34bd3c1b6654e5c in 59ms, sequenceid=6, compaction requested=false 2023-07-12 18:15:35,764 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ce4389dd8caaad3d34bd3c1b6654e5c: 2023-07-12 18:15:35,764 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,764 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:35,764 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf/0013e55a063746edbba703f274abc606] hfiles 2023-07-12 18:15:35,764 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf/0013e55a063746edbba703f274abc606 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,787 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. completed. 2023-07-12 18:15:35,787 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:35,787 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:35,787 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:35,787 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,787 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:35,787 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:15:35,789 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:35,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,789 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. completed. 2023-07-12 18:15:35,789 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:35,790 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:35,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 18:15:35,791 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:15:35,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,793 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 18:15:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 18:15:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,41341,1689185653145': 2023-07-12 18:15:35,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 18:15:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:15:35,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 18:15:35,803 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 18:15:35,803 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:35,803 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:35,803 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,803 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:35,809 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,809 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:35,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,809 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,809 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,810 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:35,811 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,811 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,814 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:35,814 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,815 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:35,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,818 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:35,818 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,818 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:35,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,820 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:35,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:35,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,821 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:35,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:35,951 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:35,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:35,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:35,953 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:15:36,253 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:36,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:36,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:36,255 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 18:15:36,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 18:15:36,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:36,328 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:36,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689185735648Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689185735820 (+172 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689185735821 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689185735836 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689185735856 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689185736327 (+471 ms) 2023-07-12 18:15:36,331 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 18:15:36,333 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 682 msec 2023-07-12 18:15:36,755 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:36,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 18:15:36,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:36,806 DEBUG [Listener at jenkins-hbase4.apache.org/36331] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:15:36,814 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:15:36,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39547] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 18:15:36,817 DEBUG [Listener at jenkins-hbase4.apache.org/36331] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:15:36,824 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41816, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:15:36,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41341] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 18:15:36,826 DEBUG [Listener at jenkins-hbase4.apache.org/36331] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 18:15:36,835 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 18:15:36,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45233] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 18:15:36,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:15:36,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:36,841 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:15:36,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 18:15:36,842 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:15:36,845 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:36,846 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 2023-07-12 18:15:36,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:36,848 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 empty. 2023-07-12 18:15:36,848 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 empty. 2023-07-12 18:15:36,849 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:36,849 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 2023-07-12 18:15:36,849 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 18:15:36,868 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 18:15:36,869 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0fe819ab403d0d768b4113cc72806635, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:15:36,872 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 991cd84651ca694651973cbf68450670, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 991cd84651ca694651973cbf68450670, disabling compactions & flushes 2023-07-12 18:15:36,894 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. after waiting 0 ms 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:36,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:36,894 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 0fe819ab403d0d768b4113cc72806635, disabling compactions & flushes 2023-07-12 18:15:36,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 991cd84651ca694651973cbf68450670: 2023-07-12 18:15:36,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:36,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:36,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. after waiting 0 ms 2023-07-12 18:15:36,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:36,895 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:36,895 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 0fe819ab403d0d768b4113cc72806635: 2023-07-12 18:15:36,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:15:36,901 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185736901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185736901"}]},"ts":"1689185736901"} 2023-07-12 18:15:36,901 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185736901"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185736901"}]},"ts":"1689185736901"} 2023-07-12 18:15:36,904 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:15:36,906 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:15:36,906 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185736906"}]},"ts":"1689185736906"} 2023-07-12 18:15:36,908 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 18:15:36,911 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:15:36,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:15:36,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:15:36,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:15:36,912 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:15:36,912 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, ASSIGN}] 2023-07-12 18:15:36,920 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, ASSIGN 2023-07-12 18:15:36,920 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, ASSIGN 2023-07-12 18:15:36,921 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39547,1689185653208; forceNewPlan=false, retain=false 2023-07-12 18:15:36,921 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:15:36,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:37,072 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:15:37,075 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0fe819ab403d0d768b4113cc72806635, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:37,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=991cd84651ca694651973cbf68450670, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:37,075 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185737075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185737075"}]},"ts":"1689185737075"} 2023-07-12 18:15:37,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185737075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185737075"}]},"ts":"1689185737075"} 2023-07-12 18:15:37,077 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 0fe819ab403d0d768b4113cc72806635, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:37,079 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 991cd84651ca694651973cbf68450670, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:15:37,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:37,233 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 991cd84651ca694651973cbf68450670, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 18:15:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. service=AccessControlService 2023-07-12 18:15:37,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:37,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:37,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0fe819ab403d0d768b4113cc72806635, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 18:15:37,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. service=AccessControlService 2023-07-12 18:15:37,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:37,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:37,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,239 INFO [StoreOpener-991cd84651ca694651973cbf68450670-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,244 INFO [StoreOpener-0fe819ab403d0d768b4113cc72806635-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,244 DEBUG [StoreOpener-991cd84651ca694651973cbf68450670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf 2023-07-12 18:15:37,244 DEBUG [StoreOpener-991cd84651ca694651973cbf68450670-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf 2023-07-12 18:15:37,245 INFO [StoreOpener-991cd84651ca694651973cbf68450670-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 991cd84651ca694651973cbf68450670 columnFamilyName cf 2023-07-12 18:15:37,245 INFO [StoreOpener-991cd84651ca694651973cbf68450670-1] regionserver.HStore(310): Store=991cd84651ca694651973cbf68450670/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:37,246 DEBUG [StoreOpener-0fe819ab403d0d768b4113cc72806635-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf 2023-07-12 18:15:37,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,246 DEBUG [StoreOpener-0fe819ab403d0d768b4113cc72806635-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf 2023-07-12 18:15:37,247 INFO [StoreOpener-0fe819ab403d0d768b4113cc72806635-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fe819ab403d0d768b4113cc72806635 columnFamilyName cf 2023-07-12 18:15:37,247 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,247 INFO [StoreOpener-0fe819ab403d0d768b4113cc72806635-1] regionserver.HStore(310): Store=0fe819ab403d0d768b4113cc72806635/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:37,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:37,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 991cd84651ca694651973cbf68450670; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63528657, jitterRate=-0.053349241614341736}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:37,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 991cd84651ca694651973cbf68450670: 2023-07-12 18:15:37,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:37,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670., pid=70, masterSystemTime=1689185737230 2023-07-12 18:15:37,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0fe819ab403d0d768b4113cc72806635; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72050598, jitterRate=0.07363757491111755}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:37,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0fe819ab403d0d768b4113cc72806635: 2023-07-12 18:15:37,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635., pid=69, masterSystemTime=1689185737229 2023-07-12 18:15:37,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:37,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:37,257 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=991cd84651ca694651973cbf68450670, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:37,257 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737257"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185737257"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185737257"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185737257"}]},"ts":"1689185737257"} 2023-07-12 18:15:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0fe819ab403d0d768b4113cc72806635, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:37,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185737258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185737258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185737258"}]},"ts":"1689185737258"} 2023-07-12 18:15:37,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-12 18:15:37,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 991cd84651ca694651973cbf68450670, server=jenkins-hbase4.apache.org,45233,1689185653260 in 180 msec 2023-07-12 18:15:37,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-12 18:15:37,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 0fe819ab403d0d768b4113cc72806635, server=jenkins-hbase4.apache.org,39547,1689185653208 in 183 msec 2023-07-12 18:15:37,264 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, ASSIGN in 350 msec 2023-07-12 18:15:37,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-12 18:15:37,265 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, ASSIGN in 351 msec 2023-07-12 18:15:37,265 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:37,265 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185737265"}]},"ts":"1689185737265"} 2023-07-12 18:15:37,267 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 18:15:37,286 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:37,287 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 18:15:37,290 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 18:15:37,293 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,293 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,293 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,293 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:37,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,302 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,303 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,304 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:37,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 463 msec 2023-07-12 18:15:37,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 18:15:37,452 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 18:15:37,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 0fe819ab403d0d768b4113cc72806635, 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0fe819ab403d0d768b4113cc72806635, 991cd84651ca694651973cbf68450670], force=true 2023-07-12 18:15:37,490 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0fe819ab403d0d768b4113cc72806635, 991cd84651ca694651973cbf68450670], force=true 2023-07-12 18:15:37,491 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0fe819ab403d0d768b4113cc72806635, 991cd84651ca694651973cbf68450670], force=true 2023-07-12 18:15:37,491 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0fe819ab403d0d768b4113cc72806635, 991cd84651ca694651973cbf68450670], force=true 2023-07-12 18:15:37,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:37,530 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, UNASSIGN}] 2023-07-12 18:15:37,536 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, UNASSIGN 2023-07-12 18:15:37,537 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, UNASSIGN 2023-07-12 18:15:37,538 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0fe819ab403d0d768b4113cc72806635, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:37,538 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737537"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185737537"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185737537"}]},"ts":"1689185737537"} 2023-07-12 18:15:37,539 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=991cd84651ca694651973cbf68450670, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:37,539 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185737539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185737539"}]},"ts":"1689185737539"} 2023-07-12 18:15:37,540 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 0fe819ab403d0d768b4113cc72806635, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:37,541 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 991cd84651ca694651973cbf68450670, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:15:37,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:37,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0fe819ab403d0d768b4113cc72806635, disabling compactions & flushes 2023-07-12 18:15:37,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. after waiting 0 ms 2023-07-12 18:15:37,695 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,695 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0fe819ab403d0d768b4113cc72806635 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 18:15:37,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 991cd84651ca694651973cbf68450670 2023-07-12 18:15:37,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 991cd84651ca694651973cbf68450670, disabling compactions & flushes 2023-07-12 18:15:37,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:37,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:37,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. after waiting 0 ms 2023-07-12 18:15:37,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:37,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 991cd84651ca694651973cbf68450670 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 18:15:37,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/.tmp/cf/c178def000fe4fa0bf03dde731cae5c6 2023-07-12 18:15:37,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/.tmp/cf/c178def000fe4fa0bf03dde731cae5c6 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf/c178def000fe4fa0bf03dde731cae5c6 2023-07-12 18:15:37,781 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf/c178def000fe4fa0bf03dde731cae5c6, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 18:15:37,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0fe819ab403d0d768b4113cc72806635 in 88ms, sequenceid=5, compaction requested=false 2023-07-12 18:15:37,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 18:15:37,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:37,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 18:15:37,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:37,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635. 2023-07-12 18:15:37,820 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0fe819ab403d0d768b4113cc72806635: 2023-07-12 18:15:37,824 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=0fe819ab403d0d768b4113cc72806635, regionState=CLOSED 2023-07-12 18:15:37,824 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185737824"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185737824"}]},"ts":"1689185737824"} 2023-07-12 18:15:37,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:37,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 18:15:37,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 0fe819ab403d0d768b4113cc72806635, server=jenkins-hbase4.apache.org,39547,1689185653208 in 286 msec 2023-07-12 18:15:37,833 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0fe819ab403d0d768b4113cc72806635, UNASSIGN in 307 msec 2023-07-12 18:15:38,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:38,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/.tmp/cf/4081b8a56bf44a8492ef0c60bedb17cf 2023-07-12 18:15:38,208 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/.tmp/cf/4081b8a56bf44a8492ef0c60bedb17cf as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf/4081b8a56bf44a8492ef0c60bedb17cf 2023-07-12 18:15:38,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf/4081b8a56bf44a8492ef0c60bedb17cf, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 18:15:38,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 991cd84651ca694651973cbf68450670 in 523ms, sequenceid=5, compaction requested=false 2023-07-12 18:15:38,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 18:15:38,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:38,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670. 2023-07-12 18:15:38,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 991cd84651ca694651973cbf68450670: 2023-07-12 18:15:38,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 991cd84651ca694651973cbf68450670 2023-07-12 18:15:38,258 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=991cd84651ca694651973cbf68450670, regionState=CLOSED 2023-07-12 18:15:38,258 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689185738258"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185738258"}]},"ts":"1689185738258"} 2023-07-12 18:15:38,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 18:15:38,264 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 991cd84651ca694651973cbf68450670, server=jenkins-hbase4.apache.org,45233,1689185653260 in 719 msec 2023-07-12 18:15:38,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-12 18:15:38,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=991cd84651ca694651973cbf68450670, UNASSIGN in 734 msec 2023-07-12 18:15:38,403 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 18:15:38,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736837.0fe819ab403d0d768b4113cc72806635.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:38,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689185736837.991cd84651ca694651973cbf68450670.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:38,407 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:38,507 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, ASSIGN}] 2023-07-12 18:15:38,508 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, ASSIGN 2023-07-12 18:15:38,510 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39547,1689185653208; forceNewPlan=false, retain=false 2023-07-12 18:15:38,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:38,661 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 18:15:38,667 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6dbd9b65bf922c659bd1141e1088b85d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:38,667 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185738667"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185738667"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185738667"}]},"ts":"1689185738667"} 2023-07-12 18:15:38,669 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 6dbd9b65bf922c659bd1141e1088b85d, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:38,826 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:38,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6dbd9b65bf922c659bd1141e1088b85d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.', STARTKEY => '', ENDKEY => ''} 2023-07-12 18:15:38,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. service=AccessControlService 2023-07-12 18:15:38,828 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:38,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:38,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/.regioninfo 2023-07-12 18:15:38,853 INFO [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,855 DEBUG [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf 2023-07-12 18:15:38,856 DEBUG [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf 2023-07-12 18:15:38,856 INFO [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6dbd9b65bf922c659bd1141e1088b85d columnFamilyName cf 2023-07-12 18:15:38,915 DEBUG [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] regionserver.HStore(539): loaded hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/4081b8a56bf44a8492ef0c60bedb17cf.991cd84651ca694651973cbf68450670->hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf/4081b8a56bf44a8492ef0c60bedb17cf-top 2023-07-12 18:15:38,942 DEBUG [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] regionserver.HStore(539): loaded hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/c178def000fe4fa0bf03dde731cae5c6.0fe819ab403d0d768b4113cc72806635->hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf/c178def000fe4fa0bf03dde731cae5c6-top 2023-07-12 18:15:38,943 INFO [StoreOpener-6dbd9b65bf922c659bd1141e1088b85d-1] regionserver.HStore(310): Store=6dbd9b65bf922c659bd1141e1088b85d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:38,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:38,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6dbd9b65bf922c659bd1141e1088b85d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72729851, jitterRate=0.08375923335552216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:38,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6dbd9b65bf922c659bd1141e1088b85d: 2023-07-12 18:15:38,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d., pid=77, masterSystemTime=1689185738822 2023-07-12 18:15:38,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.,because compaction is disabled. 2023-07-12 18:15:38,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:38,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:38,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6dbd9b65bf922c659bd1141e1088b85d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:38,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185738963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185738963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185738963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185738963"}]},"ts":"1689185738963"} 2023-07-12 18:15:38,979 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 18:15:38,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 6dbd9b65bf922c659bd1141e1088b85d, server=jenkins-hbase4.apache.org,39547,1689185653208 in 308 msec 2023-07-12 18:15:38,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 18:15:38,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, ASSIGN in 473 msec 2023-07-12 18:15:38,983 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[0fe819ab403d0d768b4113cc72806635, 991cd84651ca694651973cbf68450670], force=true in 1.5010 sec 2023-07-12 18:15:39,010 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0004_000001 (auth:SIMPLE) 2023-07-12 18:15:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 18:15:39,603 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 18:15:39,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 18:15:39,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185739603 (current time:1689185739603). 2023-07-12 18:15:39,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:39,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x15a6ef69 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:39,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a416419, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:39,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:39,614 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:39,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15a6ef69 to 127.0.0.1:61297 2023-07-12 18:15:39,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:39,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x5d387f22 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:39,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f471e4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:39,622 DEBUG [hconnection-0x6eb7dc16-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:39,623 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46980, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:39,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d387f22 to 127.0.0.1:61297 2023-07-12 18:15:39,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:39,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 18:15:39,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:39,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 18:15:39,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 18:15:39,633 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 18:15:39,636 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689186339636 2023-07-12 18:15:39,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 18:15:39,636 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,639 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:39,640 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:39,641 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 18:15:39,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 18:15:39,642 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 10 msec 2023-07-12 18:15:39,643 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 18:15:39,644 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689186339644 2023-07-12 18:15:39,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,654 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 18:15:39,654 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:39,655 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 18:15:39,656 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 18:15:39,656 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,656 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,657 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:39,658 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:39,658 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:39,658 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:39,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:39,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:39,658 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,658 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 18:15:39,659 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 18:15:39,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 18:15:39,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 18:15:39,660 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 18:15:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 18:15:39,661 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 18:15:39,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 18:15:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 18:15:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:39,662 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:39,663 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 18:15:39,664 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 18:15:39,664 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 18:15:39,664 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 18:15:39,664 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 18:15:39,664 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 18:15:39,667 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,667 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,667 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:39,668 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,668 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,668 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:39,669 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:39,669 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:39,669 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,669 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:39,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:39,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 18:15:39,671 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@689f3652[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:39,671 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 18:15:39,671 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,676 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,676 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 18:15:39,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:15:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:39,677 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:39,677 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:39,677 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. started... 2023-07-12 18:15:39,678 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6dbd9b65bf922c659bd1141e1088b85d: 2023-07-12 18:15:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 18:15:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:39,679 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 18:15:39,680 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:39,680 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 18:15:39,680 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:39,680 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 18:15:39,684 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/4081b8a56bf44a8492ef0c60bedb17cf.991cd84651ca694651973cbf68450670->hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf/4081b8a56bf44a8492ef0c60bedb17cf-top, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/c178def000fe4fa0bf03dde731cae5c6.0fe819ab403d0d768b4113cc72806635->hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf/c178def000fe4fa0bf03dde731cae5c6-top] hfiles 2023-07-12 18:15:39,684 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/4081b8a56bf44a8492ef0c60bedb17cf.991cd84651ca694651973cbf68450670 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,684 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/c178def000fe4fa0bf03dde731cae5c6.0fe819ab403d0d768b4113cc72806635 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,713 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. completed. 2023-07-12 18:15:39,713 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:39,714 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:39,714 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:39,714 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,714 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 18:15:39,714 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:15:39,720 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:39,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,724 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 18:15:39,724 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:39,724 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 18:15:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:15:39,728 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 18:15:39,729 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 18:15:39,729 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:39,729 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:39,729 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,729 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:39,731 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,731 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:39,731 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:39,731 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,732 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:39,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,732 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,732 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:39,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:39,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,733 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,734 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:39,734 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:39,737 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,737 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,738 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,740 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:39,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 18:15:39,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:39,741 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:39,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:39,743 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:39,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:39,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,743 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:39,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:39,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,744 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:39,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:39,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:39,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:39,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:39,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:39,780 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,841 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 18:15:39,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,842 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:39,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689185739636Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185739744 (+108 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185739744Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185739751 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689185739767 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689185739841 (+74 ms) 2023-07-12 18:15:39,845 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 18:15:39,846 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 206 msec 2023-07-12 18:15:39,891 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:15:39,941 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 18:15:39,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:15:39,943 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943 2023-07-12 18:15:39,943 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43721, tgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943, rawTgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:15:40,005 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:15:40,006 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1446979950_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:40,008 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 18:15:40,035 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:40,157 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:40,157 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:40,158 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:40,158 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,252 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-1957554497719237925.jar 2023-07-12 18:15:41,253 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,254 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,346 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-5330606178866887280.jar 2023-07-12 18:15:41,346 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,347 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,348 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,348 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,349 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,349 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:15:41,350 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:15:41,351 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:15:41,351 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:15:41,352 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:15:41,352 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:15:41,353 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:15:41,354 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:15:41,354 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:15:41,355 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:15:41,355 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:15:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:41,356 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:41,357 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:41,357 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:41,358 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:15:41,358 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:41,359 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:15:42,524 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:15:42,527 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 18:15:42,529 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 18:15:42,616 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:42,617 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:15:43,021 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0005_000001 (auth:SIMPLE) 2023-07-12 18:15:49,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0005_000001 (auth:SIMPLE) 2023-07-12 18:15:51,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0005_000001 (auth:SIMPLE) 2023-07-12 18:15:55,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0005_000001 (auth:SIMPLE) 2023-07-12 18:15:57,793 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:15:57,798 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:15:57,809 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:57,809 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:15:57,810 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:15:57,810 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:57,810 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 18:15:57,810 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 18:15:57,810 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 18:15:57,811 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185739943/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 18:15:57,821 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:57,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:57,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:57,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 18:15:57,826 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185757826"}]},"ts":"1689185757826"} 2023-07-12 18:15:57,829 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 18:15:57,831 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 18:15:57,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, UNASSIGN}] 2023-07-12 18:15:57,840 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, UNASSIGN 2023-07-12 18:15:57,841 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6dbd9b65bf922c659bd1141e1088b85d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:57,841 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185757841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185757841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185757841"}]},"ts":"1689185757841"} 2023-07-12 18:15:57,843 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 6dbd9b65bf922c659bd1141e1088b85d, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:57,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 18:15:57,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:57,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6dbd9b65bf922c659bd1141e1088b85d, disabling compactions & flushes 2023-07-12 18:15:57,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:57,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:57,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. after waiting 0 ms 2023-07-12 18:15:57,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:58,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 18:15:58,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:58,065 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d. 2023-07-12 18:15:58,065 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6dbd9b65bf922c659bd1141e1088b85d: 2023-07-12 18:15:58,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:58,072 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6dbd9b65bf922c659bd1141e1088b85d, regionState=CLOSED 2023-07-12 18:15:58,072 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689185758072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185758072"}]},"ts":"1689185758072"} 2023-07-12 18:15:58,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 18:15:58,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 6dbd9b65bf922c659bd1141e1088b85d, server=jenkins-hbase4.apache.org,39547,1689185653208 in 231 msec 2023-07-12 18:15:58,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 18:15:58,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6dbd9b65bf922c659bd1141e1088b85d, UNASSIGN in 246 msec 2023-07-12 18:15:58,080 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185758080"}]},"ts":"1689185758080"} 2023-07-12 18:15:58,082 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 18:15:58,083 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 18:15:58,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 263 msec 2023-07-12 18:15:58,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 18:15:58,130 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 18:15:58,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,135 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,136 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,137 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:15:58,144 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:15:58,146 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 18:15:58,147 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,147 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,147 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,147 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,147 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,147 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 18:15:58,147 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 18:15:58,147 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,148 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 18:15:58,153 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:58,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:58,155 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:58,156 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:58,163 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:58,165 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/recovered.edits] 2023-07-12 18:15:58,172 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 2023-07-12 18:15:58,172 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:58,180 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/recovered.edits] 2023-07-12 18:15:58,183 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/4081b8a56bf44a8492ef0c60bedb17cf.991cd84651ca694651973cbf68450670 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/4081b8a56bf44a8492ef0c60bedb17cf.991cd84651ca694651973cbf68450670 2023-07-12 18:15:58,191 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/recovered.edits] 2023-07-12 18:15:58,196 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/c178def000fe4fa0bf03dde731cae5c6.0fe819ab403d0d768b4113cc72806635 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/cf/c178def000fe4fa0bf03dde731cae5c6.0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:58,200 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf/c178def000fe4fa0bf03dde731cae5c6 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/cf/c178def000fe4fa0bf03dde731cae5c6 2023-07-12 18:15:58,201 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf/4081b8a56bf44a8492ef0c60bedb17cf to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/cf/4081b8a56bf44a8492ef0c60bedb17cf 2023-07-12 18:15:58,215 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/recovered.edits/8.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635/recovered.edits/8.seqid 2023-07-12 18:15:58,216 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0fe819ab403d0d768b4113cc72806635 2023-07-12 18:15:58,217 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/recovered.edits/12.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d/recovered.edits/12.seqid 2023-07-12 18:15:58,218 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6dbd9b65bf922c659bd1141e1088b85d 2023-07-12 18:15:58,218 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/recovered.edits/8.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670/recovered.edits/8.seqid 2023-07-12 18:15:58,219 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/991cd84651ca694651973cbf68450670 2023-07-12 18:15:58,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 18:15:58,229 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,237 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 18:15:58,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 18:15:58,248 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,248 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 18:15:58,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185758248"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:58,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 18:15:58,265 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 18:15:58,265 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6dbd9b65bf922c659bd1141e1088b85d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689185736838.6dbd9b65bf922c659bd1141e1088b85d.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 18:15:58,265 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 18:15:58,266 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185758265"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:58,278 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 18:15:58,282 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,287 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 151 msec 2023-07-12 18:15:58,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 18:15:58,454 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 18:15:58,455 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 18:15:58,466 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185758465"}]},"ts":"1689185758465"} 2023-07-12 18:15:58,468 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 18:15:58,471 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 18:15:58,471 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, UNASSIGN}] 2023-07-12 18:15:58,474 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, UNASSIGN 2023-07-12 18:15:58,474 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, UNASSIGN 2023-07-12 18:15:58,475 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0ce4389dd8caaad3d34bd3c1b6654e5c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:58,475 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=639bb5f408358c6cc4ef294848966fce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:58,475 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185758475"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185758475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185758475"}]},"ts":"1689185758475"} 2023-07-12 18:15:58,475 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185758475"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185758475"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185758475"}]},"ts":"1689185758475"} 2023-07-12 18:15:58,478 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 0ce4389dd8caaad3d34bd3c1b6654e5c, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:15:58,481 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 639bb5f408358c6cc4ef294848966fce, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:15:58,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 18:15:58,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ce4389dd8caaad3d34bd3c1b6654e5c, disabling compactions & flushes 2023-07-12 18:15:58,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. after waiting 0 ms 2023-07-12 18:15:58,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:58,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:58,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 639bb5f408358c6cc4ef294848966fce, disabling compactions & flushes 2023-07-12 18:15:58,633 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:58,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:58,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. after waiting 0 ms 2023-07-12 18:15:58,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:58,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:58,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:58,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:15:58,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:15:58,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce. 2023-07-12 18:15:58,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c. 2023-07-12 18:15:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 639bb5f408358c6cc4ef294848966fce: 2023-07-12 18:15:58,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ce4389dd8caaad3d34bd3c1b6654e5c: 2023-07-12 18:15:58,682 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:58,682 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=639bb5f408358c6cc4ef294848966fce, regionState=CLOSED 2023-07-12 18:15:58,682 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185758682"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185758682"}]},"ts":"1689185758682"} 2023-07-12 18:15:58,684 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:58,684 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=0ce4389dd8caaad3d34bd3c1b6654e5c, regionState=CLOSED 2023-07-12 18:15:58,684 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689185758684"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185758684"}]},"ts":"1689185758684"} 2023-07-12 18:15:58,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-12 18:15:58,690 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 639bb5f408358c6cc4ef294848966fce, server=jenkins-hbase4.apache.org,41341,1689185653145 in 205 msec 2023-07-12 18:15:58,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-12 18:15:58,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 0ce4389dd8caaad3d34bd3c1b6654e5c, server=jenkins-hbase4.apache.org,45233,1689185653260 in 209 msec 2023-07-12 18:15:58,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=639bb5f408358c6cc4ef294848966fce, UNASSIGN in 219 msec 2023-07-12 18:15:58,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-12 18:15:58,695 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=0ce4389dd8caaad3d34bd3c1b6654e5c, UNASSIGN in 219 msec 2023-07-12 18:15:58,696 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185758696"}]},"ts":"1689185758696"} 2023-07-12 18:15:58,698 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 18:15:58,701 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 18:15:58,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 246 msec 2023-07-12 18:15:58,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 18:15:58,768 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 18:15:58,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,774 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,776 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,778 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,781 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,781 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,781 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,781 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:15:58,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:15:58,783 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:58,783 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:58,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:15:58,785 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,785 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,785 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,785 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 18:15:58,782 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 18:15:58,785 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,785 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,787 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,787 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/recovered.edits] 2023-07-12 18:15:58,787 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:58,788 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/recovered.edits] 2023-07-12 18:15:58,793 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf/e4bf980338874e12b1ba4f65a0880b59 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/cf/e4bf980338874e12b1ba4f65a0880b59 2023-07-12 18:15:58,794 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf/0013e55a063746edbba703f274abc606 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/cf/0013e55a063746edbba703f274abc606 2023-07-12 18:15:58,804 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce/recovered.edits/9.seqid 2023-07-12 18:15:58,805 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/639bb5f408358c6cc4ef294848966fce 2023-07-12 18:15:58,805 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c/recovered.edits/9.seqid 2023-07-12 18:15:58,806 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/0ce4389dd8caaad3d34bd3c1b6654e5c 2023-07-12 18:15:58,806 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 18:15:58,809 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,815 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 18:15:58,822 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 18:15:58,825 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,825 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 18:15:58,825 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185758825"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:58,825 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185758825"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:58,827 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:15:58,827 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 639bb5f408358c6cc4ef294848966fce, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689185734575.639bb5f408358c6cc4ef294848966fce.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0ce4389dd8caaad3d34bd3c1b6654e5c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689185734575.0ce4389dd8caaad3d34bd3c1b6654e5c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:15:58,827 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 18:15:58,827 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185758827"}]},"ts":"9223372036854775807"} 2023-07-12 18:15:58,829 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 18:15:58,834 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 65 msec 2023-07-12 18:15:58,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 18:15:58,888 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 18:15:58,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 18:15:58,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 18:15:58,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 18:15:58,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 18:15:58,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 18:15:58,967 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=762 (was 746) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:46828 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:39243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-163794784_1 at /127.0.0.1:48656 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:38530 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-163794784_1 at /127.0.0.1:46800 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3833 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:48688 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:36331 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 885) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=579 (was 385) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 182), AvailableMemoryMB=3798 (was 4245) 2023-07-12 18:15:58,967 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 18:15:58,999 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=579, ProcessCount=179, AvailableMemoryMB=3792 2023-07-12 18:15:58,999 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 18:15:59,001 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:15:59,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:15:59,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:15:59,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 18:15:59,008 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:15:59,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:15:59,011 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,011 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,012 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 empty. 2023-07-12 18:15:59,015 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d empty. 2023-07-12 18:15:59,015 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,015 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,016 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 18:15:59,037 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 18:15:59,039 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1e9cf62039766003b05e019898cbeec1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:15:59,039 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 290d1ad1f908e0843b8ca177517a716d, NAME => 'testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:15:59,063 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:59,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 1e9cf62039766003b05e019898cbeec1, disabling compactions & flushes 2023-07-12 18:15:59,064 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. after waiting 0 ms 2023-07-12 18:15:59,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,064 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,064 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 1e9cf62039766003b05e019898cbeec1: 2023-07-12 18:15:59,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:59,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 290d1ad1f908e0843b8ca177517a716d, disabling compactions & flushes 2023-07-12 18:15:59,066 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. after waiting 0 ms 2023-07-12 18:15:59,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,066 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,066 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 290d1ad1f908e0843b8ca177517a716d: 2023-07-12 18:15:59,069 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:15:59,070 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185759070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185759070"}]},"ts":"1689185759070"} 2023-07-12 18:15:59,070 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185759070"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185759070"}]},"ts":"1689185759070"} 2023-07-12 18:15:59,073 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:15:59,074 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:15:59,074 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185759074"}]},"ts":"1689185759074"} 2023-07-12 18:15:59,077 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 18:15:59,082 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:15:59,083 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:15:59,083 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:15:59,083 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:15:59,083 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:15:59,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, ASSIGN}] 2023-07-12 18:15:59,087 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, ASSIGN 2023-07-12 18:15:59,088 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, ASSIGN 2023-07-12 18:15:59,089 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:15:59,089 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39547,1689185653208; forceNewPlan=false, retain=false 2023-07-12 18:15:59,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:15:59,239 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:15:59,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1e9cf62039766003b05e019898cbeec1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185759243"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185759243"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185759243"}]},"ts":"1689185759243"} 2023-07-12 18:15:59,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=290d1ad1f908e0843b8ca177517a716d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185759244"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185759244"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185759244"}]},"ts":"1689185759244"} 2023-07-12 18:15:59,248 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 1e9cf62039766003b05e019898cbeec1, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:15:59,249 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 290d1ad1f908e0843b8ca177517a716d, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:15:59,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:15:59,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,404 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 290d1ad1f908e0843b8ca177517a716d, NAME => 'testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:15:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1e9cf62039766003b05e019898cbeec1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:15:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. service=AccessControlService 2023-07-12 18:15:59,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. service=AccessControlService 2023-07-12 18:15:59,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:59,405 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,405 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,407 INFO [StoreOpener-1e9cf62039766003b05e019898cbeec1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,407 INFO [StoreOpener-290d1ad1f908e0843b8ca177517a716d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,408 DEBUG [StoreOpener-1e9cf62039766003b05e019898cbeec1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf 2023-07-12 18:15:59,408 DEBUG [StoreOpener-1e9cf62039766003b05e019898cbeec1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf 2023-07-12 18:15:59,409 DEBUG [StoreOpener-290d1ad1f908e0843b8ca177517a716d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf 2023-07-12 18:15:59,409 DEBUG [StoreOpener-290d1ad1f908e0843b8ca177517a716d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf 2023-07-12 18:15:59,409 INFO [StoreOpener-1e9cf62039766003b05e019898cbeec1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1e9cf62039766003b05e019898cbeec1 columnFamilyName cf 2023-07-12 18:15:59,409 INFO [StoreOpener-290d1ad1f908e0843b8ca177517a716d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 290d1ad1f908e0843b8ca177517a716d columnFamilyName cf 2023-07-12 18:15:59,409 INFO [StoreOpener-1e9cf62039766003b05e019898cbeec1-1] regionserver.HStore(310): Store=1e9cf62039766003b05e019898cbeec1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:59,410 INFO [StoreOpener-290d1ad1f908e0843b8ca177517a716d-1] regionserver.HStore(310): Store=290d1ad1f908e0843b8ca177517a716d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:15:59,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:15:59,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:15:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:59,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 290d1ad1f908e0843b8ca177517a716d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71527568, jitterRate=0.06584382057189941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:59,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 290d1ad1f908e0843b8ca177517a716d: 2023-07-12 18:15:59,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d., pid=94, masterSystemTime=1689185759400 2023-07-12 18:15:59,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:15:59,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,423 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1e9cf62039766003b05e019898cbeec1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69493759, jitterRate=0.035537704825401306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:15:59,423 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1e9cf62039766003b05e019898cbeec1: 2023-07-12 18:15:59,424 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=290d1ad1f908e0843b8ca177517a716d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,424 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1., pid=93, masterSystemTime=1689185759400 2023-07-12 18:15:59,424 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185759424"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185759424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185759424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185759424"}]},"ts":"1689185759424"} 2023-07-12 18:15:59,426 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,427 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=1e9cf62039766003b05e019898cbeec1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,427 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185759427"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185759427"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185759427"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185759427"}]},"ts":"1689185759427"} 2023-07-12 18:15:59,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-12 18:15:59,429 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 290d1ad1f908e0843b8ca177517a716d, server=jenkins-hbase4.apache.org,39547,1689185653208 in 178 msec 2023-07-12 18:15:59,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, ASSIGN in 345 msec 2023-07-12 18:15:59,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-12 18:15:59,430 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 1e9cf62039766003b05e019898cbeec1, server=jenkins-hbase4.apache.org,45233,1689185653260 in 180 msec 2023-07-12 18:15:59,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-12 18:15:59,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, ASSIGN in 346 msec 2023-07-12 18:15:59,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:15:59,434 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185759434"}]},"ts":"1689185759434"} 2023-07-12 18:15:59,436 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 18:15:59,439 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:15:59,439 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 18:15:59,441 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:15:59,446 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:59,446 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:59,446 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:59,447 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:59,448 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:15:59,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:59,448 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:59,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 18:15:59,450 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 446 msec 2023-07-12 18:15:59,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 18:15:59,613 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 18:15:59,613 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-12 18:15:59,614 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:59,617 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-12 18:15:59,617 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:15:59,617 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-12 18:15:59,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:15:59,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185759620 (current time:1689185759620). 2023-07-12 18:15:59,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:15:59,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x2b9f5726 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:59,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e77594d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:59,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:59,653 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:59,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b9f5726 to 127.0.0.1:61297 2023-07-12 18:15:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x116c1880 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:15:59,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@409b5bec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:15:59,672 DEBUG [hconnection-0x34d2cf83-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:15:59,676 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:15:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x116c1880 to 127.0.0.1:61297 2023-07-12 18:15:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:15:59,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:15:59,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:15:59,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:15:59,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:15:59,691 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:15:59,693 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186359693 2023-07-12 18:15:59,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:15:59,694 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 18:15:59,694 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:15:59,694 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:15:59,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:15:59,699 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:15:59,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-12 18:15:59,708 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:15:59,719 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186359719 2023-07-12 18:15:59,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,734 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 18:15:59,734 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:59,735 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 18:15:59,736 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:15:59,736 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,736 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,740 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:59,740 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:59,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:59,740 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:59,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:59,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:59,740 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:59,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:59,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:59,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,741 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,741 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,742 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,742 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 18:15:59,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:15:59,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,743 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:15:59,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,743 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,743 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:59,743 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:15:59,745 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:15:59,745 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:15:59,743 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:15:59,745 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:15:59,745 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:59,745 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:15:59,746 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:15:59,747 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:15:59,747 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:15:59,747 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:15:59,747 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:15:59,748 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:15:59,749 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,749 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:59,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:59,750 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,752 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,752 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:15:59,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:59,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:59,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:15:59,754 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a44f033[Count = 1] remaining members to acquire global barrier 2023-07-12 18:15:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:59,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:59,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:59,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:59,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:59,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:15:59,757 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a44f033[Count = 0] remaining members to acquire global barrier 2023-07-12 18:15:59,757 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:15:59,757 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:15:59,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:15:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:15:59,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:15:59,761 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,761 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:15:59,762 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:59,762 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:59,762 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,762 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. started... 2023-07-12 18:15:59,762 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,762 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:15:59,766 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:15:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:59,767 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:15:59,770 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:15:59,772 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:15:59,772 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e9cf62039766003b05e019898cbeec1: 2023-07-12 18:15:59,772 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,773 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. started... 2023-07-12 18:15:59,773 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,773 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:59,773 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:59,774 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 290d1ad1f908e0843b8ca177517a716d: 2023-07-12 18:15:59,775 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,775 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:15:59,775 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:15:59,795 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:15:59,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:15:59,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:15:59,805 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:15:59,812 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. completed. 2023-07-12 18:15:59,812 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:15:59,812 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:59,812 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:59,812 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,812 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:15:59,812 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:15:59,812 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. completed. 2023-07-12 18:15:59,812 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:15:59,812 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:15:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:15:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:15:59,813 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:15:59,814 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:15:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:59,814 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:15:59,817 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,817 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:15:59,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:59,817 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:59,817 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:15:59,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:59,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:15:59,822 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:15:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:59,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:59,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:59,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:15:59,827 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:15:59,827 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 18:15:59,827 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:15:59,827 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:15:59,827 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,827 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:15:59,830 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:15:59,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:59,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:59,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,831 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:15:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,832 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:15:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,834 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,834 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,835 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:59,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:59,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:59,838 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:15:59,838 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,840 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:15:59,840 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:59,840 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,841 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:15:59,841 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,841 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:15:59,841 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:15:59,841 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,841 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:15:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:15:59,840 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:15:59,841 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:59,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:59,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:15:59,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:15:59,841 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,908 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 18:15:59,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,909 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:15:59,909 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689185759694Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689185759838 (+144 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689185759840 (+2 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689185759845 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689185759860 (+15 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689185759908 (+48 ms) 2023-07-12 18:15:59,916 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:15:59,917 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 220 msec 2023-07-12 18:16:00,005 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:00,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:00,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:00,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39547] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:00,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45233] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:00,053 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:00,053 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:00,055 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:00,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:00,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185760072 (current time:1689185760072). 2023-07-12 18:16:00,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:00,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x1ed82b24 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:00,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3cd441ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:00,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:00,082 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38548, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:00,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ed82b24 to 127.0.0.1:61297 2023-07-12 18:16:00,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:00,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x00c0deee to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5f1e44d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:00,095 DEBUG [hconnection-0x41599f88-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:00,098 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38562, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:00,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00c0deee to 127.0.0.1:61297 2023-07-12 18:16:00,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:00,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 18:16:00,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:00,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:00,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:00,110 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:00,111 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689186360111 2023-07-12 18:16:00,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 18:16:00,111 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:00,112 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:00,112 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:00,113 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 18:16:00,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:00,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-12 18:16:00,116 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:00,116 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689186360116 2023-07-12 18:16:00,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,126 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 18:16:00,126 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:00,127 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 18:16:00,127 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 18:16:00,128 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,128 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,129 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:00,129 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:00,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:00,129 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:00,129 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:00,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:00,130 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,130 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,130 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,130 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,130 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 18:16:00,131 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,131 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:00,131 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:00,132 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:00,132 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:00,132 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:00,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,135 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:00,135 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 18:16:00,135 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,135 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,135 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:00,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:00,135 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:00,137 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:00,140 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 18:16:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 18:16:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 18:16:00,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,143 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,143 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,143 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:00,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,143 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,144 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b757fe[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:00,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:00,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 18:16:00,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b757fe[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:00,147 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 18:16:00,147 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,153 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,153 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:00,153 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:00,154 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:16:00,154 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:00,154 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:00,154 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. started... 2023-07-12 18:16:00,154 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:00,154 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. started... 2023-07-12 18:16:00,154 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 290d1ad1f908e0843b8ca177517a716d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 18:16:00,154 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1e9cf62039766003b05e019898cbeec1 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 18:16:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:00,169 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/.tmp/cf/343befb889a941c89463def6e09ef864 2023-07-12 18:16:00,171 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/.tmp/cf/38d6e1aef8444f2ba989ee21fc46c54c 2023-07-12 18:16:00,175 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/.tmp/cf/343befb889a941c89463def6e09ef864 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf/343befb889a941c89463def6e09ef864 2023-07-12 18:16:00,177 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/.tmp/cf/38d6e1aef8444f2ba989ee21fc46c54c as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf/38d6e1aef8444f2ba989ee21fc46c54c 2023-07-12 18:16:00,182 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf/343befb889a941c89463def6e09ef864, entries=4, sequenceid=6, filesize=5.1 K 2023-07-12 18:16:00,183 INFO [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 290d1ad1f908e0843b8ca177517a716d in 29ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:00,183 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 18:16:00,183 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 290d1ad1f908e0843b8ca177517a716d: 2023-07-12 18:16:00,184 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,186 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf/38d6e1aef8444f2ba989ee21fc46c54c, entries=46, sequenceid=6, filesize=7.9 K 2023-07-12 18:16:00,187 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 1e9cf62039766003b05e019898cbeec1 in 33ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:00,188 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:00,189 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf/343befb889a941c89463def6e09ef864] hfiles 2023-07-12 18:16:00,189 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1e9cf62039766003b05e019898cbeec1: 2023-07-12 18:16:00,190 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf/343befb889a941c89463def6e09ef864 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,190 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,191 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:00,191 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf/38d6e1aef8444f2ba989ee21fc46c54c] hfiles 2023-07-12 18:16:00,191 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf/38d6e1aef8444f2ba989ee21fc46c54c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,212 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:00,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:00,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:00,214 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:00,233 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. completed. 2023-07-12 18:16:00,234 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:16:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:00,234 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,236 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:00,236 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:16:00,239 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:00,240 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. completed. 2023-07-12 18:16:00,240 DEBUG [rs(jenkins-hbase4.apache.org,39547,1689185653208)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:00,240 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:00,240 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:00,240 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,240 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 18:16:00,240 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:16:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:00,243 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:00,246 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 18:16:00,246 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:00,246 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,246 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 18:16:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:00,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:16:00,251 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 18:16:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:00,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:00,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:00,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:00,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:00,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39547,1689185653208': 2023-07-12 18:16:00,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 18:16:00,255 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 18:16:00,255 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:00,256 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:00,256 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,256 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:00,258 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:00,258 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:00,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,258 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,259 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:00,259 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:00,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:00,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:00,260 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,260 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:00,262 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,263 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,263 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:00,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:00,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:00,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,266 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:00,266 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:00,266 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:00,267 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:00,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:00,268 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:00,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:00,269 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:00,269 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:00,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:00,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:00,269 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:00,269 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,269 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,414 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:00,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:00,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:00,417 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 18:16:00,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 18:16:00,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689185760111Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689185760266 (+155 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689185760266Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689185760272 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689185760282 (+10 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689185760713 (+431 ms) 2023-07-12 18:16:00,717 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:00,717 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 18:16:00,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 18:16:00,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:00,718 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718 2023-07-12 18:16:00,718 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 605 msec 2023-07-12 18:16:00,718 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43721, tgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718, rawTgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:16:00,742 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:16:00,743 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1837133571_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,743 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 18:16:00,748 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:00,777 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:00,778 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:00,778 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:00,778 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:01,928 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-7802820125793495.jar 2023-07-12 18:16:01,929 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:01,930 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,016 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-4830115325886340037.jar 2023-07-12 18:16:02,016 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,017 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,017 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,018 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,018 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,018 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:02,019 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:16:02,019 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:16:02,020 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:16:02,020 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:16:02,021 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:16:02,021 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:16:02,024 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:16:02,026 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:16:02,026 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:16:02,027 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:16:02,028 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:02,029 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:02,029 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:02,030 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0005_000001 (auth:SIMPLE) 2023-07-12 18:16:02,030 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:02,035 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:03,597 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:16:03,600 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 18:16:03,682 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:16:03,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:03,940 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:04,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0006_000001 (auth:SIMPLE) 2023-07-12 18:16:09,495 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0006_000001 (auth:SIMPLE) 2023-07-12 18:16:12,315 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:16:12,317 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:16:12,331 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:12,331 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:16:12,332 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:16:12,332 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:12,332 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 18:16:12,333 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 18:16:12,333 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:12,333 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 18:16:12,333 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185760718/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 18:16:12,369 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,384 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185772384"}]},"ts":"1689185772384"} 2023-07-12 18:16:12,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 18:16:12,386 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 18:16:12,388 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 18:16:12,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, UNASSIGN}] 2023-07-12 18:16:12,391 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, UNASSIGN 2023-07-12 18:16:12,393 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, UNASSIGN 2023-07-12 18:16:12,393 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1e9cf62039766003b05e019898cbeec1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:12,394 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185772393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185772393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185772393"}]},"ts":"1689185772393"} 2023-07-12 18:16:12,394 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=290d1ad1f908e0843b8ca177517a716d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:12,394 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185772394"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185772394"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185772394"}]},"ts":"1689185772394"} 2023-07-12 18:16:12,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 1e9cf62039766003b05e019898cbeec1, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:16:12,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 290d1ad1f908e0843b8ca177517a716d, server=jenkins-hbase4.apache.org,39547,1689185653208}] 2023-07-12 18:16:12,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 18:16:12,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:16:12,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1e9cf62039766003b05e019898cbeec1, disabling compactions & flushes 2023-07-12 18:16:12,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. after waiting 0 ms 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:16:12,551 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 290d1ad1f908e0843b8ca177517a716d, disabling compactions & flushes 2023-07-12 18:16:12,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. after waiting 0 ms 2023-07-12 18:16:12,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:12,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:12,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:12,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:12,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:12,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1. 2023-07-12 18:16:12,635 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d. 2023-07-12 18:16:12,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1e9cf62039766003b05e019898cbeec1: 2023-07-12 18:16:12,635 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 290d1ad1f908e0843b8ca177517a716d: 2023-07-12 18:16:12,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:16:12,639 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=290d1ad1f908e0843b8ca177517a716d, regionState=CLOSED 2023-07-12 18:16:12,640 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185772639"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185772639"}]},"ts":"1689185772639"} 2023-07-12 18:16:12,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1e9cf62039766003b05e019898cbeec1 2023-07-12 18:16:12,640 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=1e9cf62039766003b05e019898cbeec1, regionState=CLOSED 2023-07-12 18:16:12,640 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689185772640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185772640"}]},"ts":"1689185772640"} 2023-07-12 18:16:12,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-12 18:16:12,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 290d1ad1f908e0843b8ca177517a716d, server=jenkins-hbase4.apache.org,39547,1689185653208 in 244 msec 2023-07-12 18:16:12,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-12 18:16:12,644 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 1e9cf62039766003b05e019898cbeec1, server=jenkins-hbase4.apache.org,45233,1689185653260 in 246 msec 2023-07-12 18:16:12,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=290d1ad1f908e0843b8ca177517a716d, UNASSIGN in 253 msec 2023-07-12 18:16:12,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-12 18:16:12,646 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=1e9cf62039766003b05e019898cbeec1, UNASSIGN in 254 msec 2023-07-12 18:16:12,646 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185772646"}]},"ts":"1689185772646"} 2023-07-12 18:16:12,648 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 18:16:12,651 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 18:16:12,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 281 msec 2023-07-12 18:16:12,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 18:16:12,687 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 18:16:12,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,693 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,694 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,697 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,697 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,697 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,697 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:12,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:12,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:12,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 18:16:12,698 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 2023-07-12 18:16:12,698 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,699 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:12,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 18:16:12,701 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/recovered.edits] 2023-07-12 18:16:12,701 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/recovered.edits] 2023-07-12 18:16:12,705 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf/38d6e1aef8444f2ba989ee21fc46c54c to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/cf/38d6e1aef8444f2ba989ee21fc46c54c 2023-07-12 18:16:12,706 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf/343befb889a941c89463def6e09ef864 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/cf/343befb889a941c89463def6e09ef864 2023-07-12 18:16:12,709 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1/recovered.edits/9.seqid 2023-07-12 18:16:12,709 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/1e9cf62039766003b05e019898cbeec1 2023-07-12 18:16:12,709 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d/recovered.edits/9.seqid 2023-07-12 18:16:12,710 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testEmptyExportFileSystemState/290d1ad1f908e0843b8ca177517a716d 2023-07-12 18:16:12,710 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 18:16:12,712 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,714 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 18:16:12,716 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 18:16:12,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 18:16:12,718 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185772717"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:12,718 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185772717"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:12,719 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:16:12,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 290d1ad1f908e0843b8ca177517a716d, NAME => 'testtb-testEmptyExportFileSystemState,,1689185759000.290d1ad1f908e0843b8ca177517a716d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1e9cf62039766003b05e019898cbeec1, NAME => 'testtb-testEmptyExportFileSystemState,1,1689185759000.1e9cf62039766003b05e019898cbeec1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:16:12,720 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 18:16:12,720 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185772720"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:12,721 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 18:16:12,724 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 18:16:12,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-07-12 18:16:12,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 18:16:12,801 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 18:16:12,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 18:16:12,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:12,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 18:16:12,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 18:16:12,846 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=763 (was 762) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:39033 from appattempt_1689185662410_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:48244 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:59944 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:32844 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4605 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:41619 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-29224205_1 at /127.0.0.1:32810 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=636 (was 579) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=4013 (was 3792) - AvailableMemoryMB LEAK? - 2023-07-12 18:16:12,847 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 18:16:12,872 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=636, ProcessCount=179, AvailableMemoryMB=4011 2023-07-12 18:16:12,872 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 18:16:12,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 18:16:12,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:12,877 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 18:16:12,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 18:16:12,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:12,882 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 18:16:12,884 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:12,884 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:12,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db empty. 2023-07-12 18:16:12,885 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c empty. 2023-07-12 18:16:12,886 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:12,886 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:12,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 18:16:12,911 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 18:16:12,912 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2623c76b9623316028ea6ea57198b9db, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:16:12,913 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 10fb1c2cac1fcf20a88ff5fb36529d0c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp 2023-07-12 18:16:12,954 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:12,954 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 2623c76b9623316028ea6ea57198b9db, disabling compactions & flushes 2023-07-12 18:16:12,954 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:12,954 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:12,954 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. after waiting 0 ms 2023-07-12 18:16:12,954 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:12,954 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:12,954 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 2623c76b9623316028ea6ea57198b9db: 2023-07-12 18:16:12,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:12,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 10fb1c2cac1fcf20a88ff5fb36529d0c, disabling compactions & flushes 2023-07-12 18:16:12,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:12,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:12,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. after waiting 0 ms 2023-07-12 18:16:12,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:12,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:12,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 10fb1c2cac1fcf20a88ff5fb36529d0c: 2023-07-12 18:16:12,978 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 18:16:12,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185772980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185772980"}]},"ts":"1689185772980"} 2023-07-12 18:16:12,980 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185772980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185772980"}]},"ts":"1689185772980"} 2023-07-12 18:16:12,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:12,987 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 18:16:12,988 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 18:16:12,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185772988"}]},"ts":"1689185772988"} 2023-07-12 18:16:12,990 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 18:16:12,993 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 18:16:12,995 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 18:16:12,995 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 18:16:12,995 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 18:16:12,995 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 18:16:12,995 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, ASSIGN}] 2023-07-12 18:16:13,000 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, ASSIGN 2023-07-12 18:16:13,000 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, ASSIGN 2023-07-12 18:16:13,001 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45233,1689185653260; forceNewPlan=false, retain=false 2023-07-12 18:16:13,001 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41341,1689185653145; forceNewPlan=false, retain=false 2023-07-12 18:16:13,153 INFO [jenkins-hbase4:33521] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 18:16:13,156 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=10fb1c2cac1fcf20a88ff5fb36529d0c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,157 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185773156"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185773156"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185773156"}]},"ts":"1689185773156"} 2023-07-12 18:16:13,157 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2623c76b9623316028ea6ea57198b9db, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,157 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185773157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185773157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185773157"}]},"ts":"1689185773157"} 2023-07-12 18:16:13,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 10fb1c2cac1fcf20a88ff5fb36529d0c, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:16:13,162 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 2623c76b9623316028ea6ea57198b9db, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:16:13,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:13,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:13,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 10fb1c2cac1fcf20a88ff5fb36529d0c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 18:16:13,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. service=AccessControlService 2023-07-12 18:16:13,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:16:13,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:13,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,321 INFO [StoreOpener-10fb1c2cac1fcf20a88ff5fb36529d0c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:13,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2623c76b9623316028ea6ea57198b9db, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 18:16:13,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. service=AccessControlService 2023-07-12 18:16:13,322 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 18:16:13,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,322 DEBUG [StoreOpener-10fb1c2cac1fcf20a88ff5fb36529d0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf 2023-07-12 18:16:13,322 DEBUG [StoreOpener-10fb1c2cac1fcf20a88ff5fb36529d0c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf 2023-07-12 18:16:13,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 18:16:13,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,322 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,322 INFO [StoreOpener-10fb1c2cac1fcf20a88ff5fb36529d0c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 10fb1c2cac1fcf20a88ff5fb36529d0c columnFamilyName cf 2023-07-12 18:16:13,323 INFO [StoreOpener-10fb1c2cac1fcf20a88ff5fb36529d0c-1] regionserver.HStore(310): Store=10fb1c2cac1fcf20a88ff5fb36529d0c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:16:13,323 INFO [StoreOpener-2623c76b9623316028ea6ea57198b9db-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,325 DEBUG [StoreOpener-2623c76b9623316028ea6ea57198b9db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf 2023-07-12 18:16:13,325 DEBUG [StoreOpener-2623c76b9623316028ea6ea57198b9db-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf 2023-07-12 18:16:13,325 INFO [StoreOpener-2623c76b9623316028ea6ea57198b9db-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2623c76b9623316028ea6ea57198b9db columnFamilyName cf 2023-07-12 18:16:13,326 INFO [StoreOpener-2623c76b9623316028ea6ea57198b9db-1] regionserver.HStore(310): Store=2623c76b9623316028ea6ea57198b9db/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 18:16:13,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:13,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:13,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:16:13,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2623c76b9623316028ea6ea57198b9db; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70690459, jitterRate=0.053369924426078796}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:16:13,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2623c76b9623316028ea6ea57198b9db: 2023-07-12 18:16:13,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 18:16:13,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db., pid=109, masterSystemTime=1689185773315 2023-07-12 18:16:13,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 10fb1c2cac1fcf20a88ff5fb36529d0c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59017452, jitterRate=-0.12057143449783325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 18:16:13,333 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 10fb1c2cac1fcf20a88ff5fb36529d0c: 2023-07-12 18:16:13,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c., pid=108, masterSystemTime=1689185773312 2023-07-12 18:16:13,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:13,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:13,334 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=2623c76b9623316028ea6ea57198b9db, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:13,334 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:13,335 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185773334"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185773334"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185773334"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185773334"}]},"ts":"1689185773334"} 2023-07-12 18:16:13,335 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=10fb1c2cac1fcf20a88ff5fb36529d0c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,335 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185773335"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689185773335"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689185773335"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689185773335"}]},"ts":"1689185773335"} 2023-07-12 18:16:13,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 18:16:13,338 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 2623c76b9623316028ea6ea57198b9db, server=jenkins-hbase4.apache.org,41341,1689185653145 in 174 msec 2023-07-12 18:16:13,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 18:16:13,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 10fb1c2cac1fcf20a88ff5fb36529d0c, server=jenkins-hbase4.apache.org,45233,1689185653260 in 177 msec 2023-07-12 18:16:13,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, ASSIGN in 343 msec 2023-07-12 18:16:13,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 18:16:13,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, ASSIGN in 343 msec 2023-07-12 18:16:13,341 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 18:16:13,341 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185773341"}]},"ts":"1689185773341"} 2023-07-12 18:16:13,342 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 18:16:13,345 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 18:16:13,345 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 18:16:13,346 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 18:16:13,357 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:13,357 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:13,357 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:13,357 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:13,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:13,359 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:13,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:13,360 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 18:16:13,361 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 485 msec 2023-07-12 18:16:13,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 18:16:13,486 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 18:16:13,486 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-12 18:16:13,486 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:13,490 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-12 18:16:13,490 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:13,490 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-12 18:16:13,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185773495 (current time:1689185773495). 2023-07-12 18:16:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:13,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x3a5a2f2a to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:13,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ca46a1b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:13,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:13,512 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:13,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a5a2f2a to 127.0.0.1:61297 2023-07-12 18:16:13,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:13,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x4cc3001c to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:13,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@278b45d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:13,521 DEBUG [hconnection-0x8d01789-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:13,522 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:13,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cc3001c to 127.0.0.1:61297 2023-07-12 18:16:13,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:13,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 18:16:13,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:13,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:13,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:13,534 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:13,535 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689186373535 2023-07-12 18:16:13,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:13,535 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,536 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:13,536 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:13,537 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:13,537 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:13,538 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-12 18:16:13,539 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:13,540 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689186373540 2023-07-12 18:16:13,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,549 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 18:16:13,549 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,550 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 18:16:13,550 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 18:16:13,551 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,551 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,552 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,552 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,552 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,552 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,553 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,553 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,553 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 18:16:13,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:13,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:13,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:13,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,554 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:13,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,554 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,554 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:13,554 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,556 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:13,558 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:13,559 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:13,570 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,570 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,570 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,570 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:13,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,571 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:13,574 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,574 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bfcd4[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:13,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:13,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:13,578 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9bfcd4[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:13,578 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 18:16:13,578 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:13,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,580 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:16:13,581 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:13,581 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:13,581 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. started... 2023-07-12 18:16:13,581 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:13,581 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. started... 2023-07-12 18:16:13,583 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10fb1c2cac1fcf20a88ff5fb36529d0c: 2023-07-12 18:16:13,584 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2623c76b9623316028ea6ea57198b9db: 2023-07-12 18:16:13,584 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,585 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,585 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:13,585 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,585 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:13,585 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:16:13,585 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:13,585 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 18:16:13,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:13,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:13,586 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:13,606 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. completed. 2023-07-12 18:16:13,606 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:13,606 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:13,606 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:13,606 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,606 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:13,606 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:16:13,608 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:13,609 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:13,609 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,609 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:13,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:13,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,613 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. completed. 2023-07-12 18:16:13,613 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:13,613 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:13,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,613 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:13,613 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,614 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:13,614 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:16:13,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:13,623 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:13,623 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,623 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:13,623 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:13,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41341,1689185653145': 2023-07-12 18:16:13,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 18:16:13,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:13,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:13,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:13,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:13,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:13,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:16:13,632 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 18:16:13,632 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 18:16:13,633 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:13,633 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:13,633 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,633 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:13,636 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,636 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,636 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:13,636 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:13,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,636 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:13,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:13,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:13,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:13,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:13,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:13,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:13,638 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:13,638 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,638 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,638 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:13,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:13,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:13,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:13,639 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:13,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:13,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,640 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,641 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:13,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,644 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,644 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:13,645 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,649 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,649 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,649 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,649 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:13,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,650 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,649 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:13,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,649 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:13,650 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:13,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:13,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,650 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,650 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:13,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:13,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:13,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:13,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:13,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,827 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 18:16:13,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,828 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,828 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689185773535Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185773651 (+116 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185773651Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185773668 (+17 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689185773696 (+28 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689185773827 (+131 ms) 2023-07-12 18:16:13,831 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:13,832 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 295 msec 2023-07-12 18:16:13,838 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:13,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:13,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:13,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41341] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:13,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45233] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 18:16:13,854 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,854 DEBUG [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:13,854 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 18:16:13,877 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:13,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689185773877 (current time:1689185773877). 2023-07-12 18:16:13,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 18:16:13,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x71d9d173 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:13,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@793dec9e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:13,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:13,903 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44844, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:13,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71d9d173 to 127.0.0.1:61297 2023-07-12 18:16:13,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:13,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(139): Connect 0x1400f9a7 to 127.0.0.1:61297 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 18:16:13,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bedf01d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 18:16:13,929 DEBUG [hconnection-0x3da2b0e2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 18:16:13,934 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 18:16:13,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1400f9a7 to 127.0.0.1:61297 2023-07-12 18:16:13,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:16:13,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 18:16:13,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 18:16:13,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:13,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:13,948 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:13,949 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689186373949 2023-07-12 18:16:13,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 18:16:13,950 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,950 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 18:16:13,950 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 18:16:13,953 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 18:16:13,954 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:13,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-12 18:16:13,956 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:13,956 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689186373956 2023-07-12 18:16:13,973 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,973 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 18:16:13,973 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,975 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 18:16:13,975 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 18:16:13,976 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,976 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,977 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,977 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,977 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,977 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:13,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:13,978 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,978 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,979 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,979 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:13,979 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 18:16:13,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 18:16:13,980 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,980 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:13,980 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,982 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,983 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:13,983 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,987 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 18:16:13,987 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 18:16:13,989 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39547,1689185653208' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 18:16:13,995 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,995 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:13,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:13,996 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:13,997 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,997 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:13,997 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:13,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:13,997 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:13,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,000 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,000 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,000 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,000 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,41341,1689185653145' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11a76733[Count = 1] remaining members to acquire global barrier 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:14,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:14,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:14,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,45233,1689185653260' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 18:16:14,004 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11a76733[Count = 0] remaining members to acquire global barrier 2023-07-12 18:16:14,004 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 18:16:14,004 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,009 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:14,009 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:14,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,010 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39547,1689185653208' in zk 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:14,010 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:14,010 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. started... 2023-07-12 18:16:14,010 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 18:16:14,010 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:14,010 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,010 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2623c76b9623316028ea6ea57198b9db 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-12 18:16:14,010 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. started... 2023-07-12 18:16:14,010 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 18:16:14,011 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 10fb1c2cac1fcf20a88ff5fb36529d0c 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-12 18:16:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:14,012 DEBUG [member: 'jenkins-hbase4.apache.org,39547,1689185653208' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:14,040 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=65 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/.tmp/cf/3a170e1d8cca418ca45526a5270a9c61 2023-07-12 18:16:14,042 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.19 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/.tmp/cf/6a01d949d014460f8400d4785a856252 2023-07-12 18:16:14,048 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/.tmp/cf/3a170e1d8cca418ca45526a5270a9c61 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf/3a170e1d8cca418ca45526a5270a9c61 2023-07-12 18:16:14,050 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:14,051 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/.tmp/cf/6a01d949d014460f8400d4785a856252 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf/6a01d949d014460f8400d4785a856252 2023-07-12 18:16:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:14,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 18:16:14,052 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 18:16:14,061 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf/3a170e1d8cca418ca45526a5270a9c61, entries=1, sequenceid=6, filesize=4.9 K 2023-07-12 18:16:14,062 INFO [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 2623c76b9623316028ea6ea57198b9db in 52ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:14,062 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 18:16:14,062 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2623c76b9623316028ea6ea57198b9db: 2023-07-12 18:16:14,063 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,063 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:14,063 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf/3a170e1d8cca418ca45526a5270a9c61] hfiles 2023-07-12 18:16:14,063 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf/3a170e1d8cca418ca45526a5270a9c61 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,069 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf/6a01d949d014460f8400d4785a856252, entries=49, sequenceid=6, filesize=8.1 K 2023-07-12 18:16:14,069 INFO [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 10fb1c2cac1fcf20a88ff5fb36529d0c in 58ms, sequenceid=6, compaction requested=false 2023-07-12 18:16:14,076 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 10fb1c2cac1fcf20a88ff5fb36529d0c: 2023-07-12 18:16:14,076 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,076 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 18:16:14,076 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf/6a01d949d014460f8400d4785a856252] hfiles 2023-07-12 18:16:14,077 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf/6a01d949d014460f8400d4785a856252 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,099 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. completed. 2023-07-12 18:16:14,099 DEBUG [rs(jenkins-hbase4.apache.org,41341,1689185653145)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:14,099 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:14,099 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:14,099 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,099 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:14,099 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,41341,1689185653145' in zk 2023-07-12 18:16:14,102 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,102 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:14,102 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:14,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:14,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:14,102 DEBUG [member: 'jenkins-hbase4.apache.org,41341,1689185653145' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:14,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:14,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:14,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,41341,1689185653145': 2023-07-12 18:16:14,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,41341,1689185653145' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 18:16:14,120 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. completed. 2023-07-12 18:16:14,120 DEBUG [rs(jenkins-hbase4.apache.org,45233,1689185653260)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 18:16:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 18:16:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 18:16:14,120 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,45233,1689185653260' in zk 2023-07-12 18:16:14,122 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 18:16:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:14,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,122 DEBUG [member: 'jenkins-hbase4.apache.org,45233,1689185653260' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 18:16:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:14,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:14,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,45233,1689185653260': 2023-07-12 18:16:14,128 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,45233,1689185653260' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 18:16:14,128 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 18:16:14,129 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 18:16:14,129 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 18:16:14,129 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,129 INFO [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 18:16:14,130 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,130 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 18:16:14,130 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,131 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:14,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,130 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,130 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:14,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,131 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 18:16:14,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:14,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:14,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:14,132 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:14,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,134 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 18:16:14,134 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 18:16:14,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,136 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,137 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,137 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,140 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:14,140 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:14,140 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:14,140 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 18:16:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:14,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:14,140 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:14,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 18:16:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:14,140 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 18:16:14,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:14,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 18:16:14,141 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,141 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,141 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,141 DEBUG [(jenkins-hbase4.apache.org,33521,1689185651624)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 18:16:14,141 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,141 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,144 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:14,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:14,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 18:16:14,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 18:16:14,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,198 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 18:16:14,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,199 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,199 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689185773950Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689185774143 (+193 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689185774143Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689185774154 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689185774167 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689185774198 (+31 ms) 2023-07-12 18:16:14,202 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 18:16:14,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 250 msec 2023-07-12 18:16:14,252 DEBUG [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 18:16:14,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 18:16:14,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 18:16:14,254 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254 2023-07-12 18:16:14,254 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:43721, tgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254, rawTgtDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254, srcFsUri=hdfs://localhost:43721, srcDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:16:14,287 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a 2023-07-12 18:16:14,288 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1157758457_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,288 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:43721, inputRoot=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a, snapshotDir=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 18:16:14,299 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:14,323 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:14,323 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:14,323 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:14,324 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,446 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-9070892939942123985.jar 2023-07-12 18:16:15,446 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,447 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,525 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/hadoop-4301859554967292013.jar 2023-07-12 18:16:15,526 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,526 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,527 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,527 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,528 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,528 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 18:16:15,529 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 18:16:15,529 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 18:16:15,530 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 18:16:15,530 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 18:16:15,530 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 18:16:15,531 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 18:16:15,531 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 18:16:15,531 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 18:16:15,532 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 18:16:15,532 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 18:16:15,533 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:15,533 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:15,534 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:15,534 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:15,535 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 18:16:15,535 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:15,536 DEBUG [Listener at jenkins-hbase4.apache.org/36331] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 18:16:16,164 WARN [Listener at jenkins-hbase4.apache.org/36331] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 18:16:16,167 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 18:16:16,169 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-12 18:16:16,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:16,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 18:16:16,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0006_000001 (auth:SIMPLE) 2023-07-12 18:16:17,753 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:18,238 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:16:23,355 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:25,859 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:29,832 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689185662410_0007_000001 (auth:SIMPLE) 2023-07-12 18:16:31,464 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 18:16:31,464 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 18:16:31,521 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,521 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 18:16:31,522 INFO [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 18:16:31,522 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,523 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 18:16:31,523 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 18:16:31,523 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1234494839_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,523 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 18:16:31,524 DEBUG [Listener at jenkins-hbase4.apache.org/36331] snapshot.TestExportSnapshot(367): hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/export-test/export-1689185774254/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 18:16:31,534 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 18:16:31,540 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185791540"}]},"ts":"1689185791540"} 2023-07-12 18:16:31,542 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 18:16:31,544 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 18:16:31,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, UNASSIGN}] 2023-07-12 18:16:31,545 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, UNASSIGN 2023-07-12 18:16:31,546 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2623c76b9623316028ea6ea57198b9db, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:16:31,546 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185791546"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185791546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185791546"}]},"ts":"1689185791546"} 2023-07-12 18:16:31,548 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 2623c76b9623316028ea6ea57198b9db, server=jenkins-hbase4.apache.org,41341,1689185653145}] 2023-07-12 18:16:31,550 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, UNASSIGN 2023-07-12 18:16:31,552 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=10fb1c2cac1fcf20a88ff5fb36529d0c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:16:31,552 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185791552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689185791552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689185791552"}]},"ts":"1689185791552"} 2023-07-12 18:16:31,555 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 10fb1c2cac1fcf20a88ff5fb36529d0c, server=jenkins-hbase4.apache.org,45233,1689185653260}] 2023-07-12 18:16:31,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 18:16:31,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:31,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2623c76b9623316028ea6ea57198b9db, disabling compactions & flushes 2023-07-12 18:16:31,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:31,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:31,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. after waiting 0 ms 2023-07-12 18:16:31,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:31,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:31,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 10fb1c2cac1fcf20a88ff5fb36529d0c, disabling compactions & flushes 2023-07-12 18:16:31,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:31,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:31,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. after waiting 0 ms 2023-07-12 18:16:31,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:31,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:31,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:31,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db. 2023-07-12 18:16:31,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2623c76b9623316028ea6ea57198b9db: 2023-07-12 18:16:31,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:31,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:16:31,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:16:31,747 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c. 2023-07-12 18:16:31,747 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 10fb1c2cac1fcf20a88ff5fb36529d0c: 2023-07-12 18:16:31,749 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=2623c76b9623316028ea6ea57198b9db, regionState=CLOSED 2023-07-12 18:16:31,749 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185791749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185791749"}]},"ts":"1689185791749"} 2023-07-12 18:16:31,754 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=10fb1c2cac1fcf20a88ff5fb36529d0c, regionState=CLOSED 2023-07-12 18:16:31,754 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689185791753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689185791753"}]},"ts":"1689185791753"} 2023-07-12 18:16:31,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-12 18:16:31,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 2623c76b9623316028ea6ea57198b9db, server=jenkins-hbase4.apache.org,41341,1689185653145 in 204 msec 2023-07-12 18:16:31,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2623c76b9623316028ea6ea57198b9db, UNASSIGN in 212 msec 2023-07-12 18:16:31,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:31,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-12 18:16:31,760 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 10fb1c2cac1fcf20a88ff5fb36529d0c, server=jenkins-hbase4.apache.org,45233,1689185653260 in 202 msec 2023-07-12 18:16:31,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-12 18:16:31,763 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=10fb1c2cac1fcf20a88ff5fb36529d0c, UNASSIGN in 216 msec 2023-07-12 18:16:31,764 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689185791764"}]},"ts":"1689185791764"} 2023-07-12 18:16:31,766 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 18:16:31,768 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 18:16:31,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 235 msec 2023-07-12 18:16:31,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 18:16:31,843 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 18:16:31,844 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,847 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,848 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,849 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45233] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,851 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,851 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,851 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,851 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:31,852 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:31,853 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,853 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 18:16:31,853 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 18:16:31,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 18:16:31,863 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:31,863 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:31,867 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/recovered.edits] 2023-07-12 18:16:31,867 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf, FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/recovered.edits] 2023-07-12 18:16:31,875 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf/3a170e1d8cca418ca45526a5270a9c61 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/cf/3a170e1d8cca418ca45526a5270a9c61 2023-07-12 18:16:31,875 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf/6a01d949d014460f8400d4785a856252 to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/cf/6a01d949d014460f8400d4785a856252 2023-07-12 18:16:31,878 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db/recovered.edits/9.seqid 2023-07-12 18:16:31,878 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/recovered.edits/9.seqid to hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c/recovered.edits/9.seqid 2023-07-12 18:16:31,879 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/10fb1c2cac1fcf20a88ff5fb36529d0c 2023-07-12 18:16:31,879 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2623c76b9623316028ea6ea57198b9db 2023-07-12 18:16:31,879 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 18:16:31,882 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,885 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 18:16:31,897 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 18:16:31,898 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,898 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 18:16:31,899 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185791899"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:31,899 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689185791899"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:31,901 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 18:16:31,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2623c76b9623316028ea6ea57198b9db, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689185772874.2623c76b9623316028ea6ea57198b9db.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 10fb1c2cac1fcf20a88ff5fb36529d0c, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689185772874.10fb1c2cac1fcf20a88ff5fb36529d0c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 18:16:31,901 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 18:16:31,901 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689185791901"}]},"ts":"9223372036854775807"} 2023-07-12 18:16:31,917 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 18:16:31,921 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,924 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 77 msec 2023-07-12 18:16:31,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 18:16:31,956 INFO [Listener at jenkins-hbase4.apache.org/36331] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 18:16:31,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 18:16:31,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:31,973 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33521] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 18:16:31,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=33521] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 18:16:32,013 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 763) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:60562 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:54588 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (449583813) connection to jenkins-hbase4.apache.org/172.31.14.131:44951 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1606298631_1 at /127.0.0.1:54452 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x78e748cd-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1234494839_17 at /127.0.0.1:37114 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1606298631_1 at /127.0.0.1:44846 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5213 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=897 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=668 (was 636) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=2770 (was 4011) 2023-07-12 18:16:32,013 WARN [Listener at jenkins-hbase4.apache.org/36331] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-12 18:16:32,014 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 18:16:32,035 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:16:32,161 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689185662410_0007_01_000001 is : 143 2023-07-12 18:16:37,311 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 18:16:46,176 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:17:00,296 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 18:17:00,297 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:17:00,408 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 18:17:00,417 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 18:17:00,419 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 18:17:00,430 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 18:17:00,534 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 18:17:00,534 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 18:17:00,534 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 18:17:00,534 INFO [Listener at jenkins-hbase4.apache.org/36331] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 18:17:00,534 DEBUG [Listener at jenkins-hbase4.apache.org/36331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b401a43 to 127.0.0.1:61297 2023-07-12 18:17:00,534 DEBUG [Listener at jenkins-hbase4.apache.org/36331] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,535 DEBUG [Listener at jenkins-hbase4.apache.org/36331] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 18:17:00,535 DEBUG [Listener at jenkins-hbase4.apache.org/36331] util.JVMClusterUtil(257): Found active master hash=523149944, stopped=false 2023-07-12 18:17:00,535 DEBUG [Listener at jenkins-hbase4.apache.org/36331] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,535 DEBUG [Listener at jenkins-hbase4.apache.org/36331] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 18:17:00,535 INFO [Listener at jenkins-hbase4.apache.org/36331] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:17:00,537 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:00,537 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:00,537 INFO [Listener at jenkins-hbase4.apache.org/36331] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 18:17:00,537 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:00,537 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 18:17:00,537 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:17:00,537 DEBUG [Listener at jenkins-hbase4.apache.org/36331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09f171c4 to 127.0.0.1:61297 2023-07-12 18:17:00,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:00,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:00,537 DEBUG [Listener at jenkins-hbase4.apache.org/36331] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:00,538 INFO [Listener at jenkins-hbase4.apache.org/36331] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41341,1689185653145' ***** 2023-07-12 18:17:00,538 DEBUG [Listener at jenkins-hbase4.apache.org/36331] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,538 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 18:17:00,538 INFO [Listener at jenkins-hbase4.apache.org/36331] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:17:00,538 INFO [Listener at jenkins-hbase4.apache.org/36331] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39547,1689185653208' ***** 2023-07-12 18:17:00,538 DEBUG [Listener at jenkins-hbase4.apache.org/36331] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,538 INFO [Listener at jenkins-hbase4.apache.org/36331] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:17:00,538 INFO [Listener at jenkins-hbase4.apache.org/36331] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45233,1689185653260' ***** 2023-07-12 18:17:00,538 INFO [RS:0;jenkins-hbase4:41341] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:17:00,538 INFO [RS:1;jenkins-hbase4:39547] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:17:00,538 DEBUG [Listener at jenkins-hbase4.apache.org/36331] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,539 INFO [RS:1;jenkins-hbase4:39547] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:17:00,539 INFO [RS:0;jenkins-hbase4:41341] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:17:00,539 INFO [RS:1;jenkins-hbase4:39547] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:17:00,539 INFO [RS:0;jenkins-hbase4:41341] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:17:00,539 INFO [Listener at jenkins-hbase4.apache.org/36331] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 18:17:00,539 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:17:00,539 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:17:00,539 DEBUG [RS:1;jenkins-hbase4:39547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc13d66 to 127.0.0.1:61297 2023-07-12 18:17:00,539 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:17:00,539 DEBUG [RS:1;jenkins-hbase4:39547] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,539 INFO [RS:2;jenkins-hbase4:45233] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 18:17:00,539 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(3305): Received CLOSE for 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:17:00,541 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 18:17:00,541 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39547,1689185653208; all regions closed. 2023-07-12 18:17:00,541 INFO [RS:2;jenkins-hbase4:45233] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 18:17:00,541 INFO [RS:2;jenkins-hbase4:45233] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 18:17:00,541 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(3305): Received CLOSE for 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:17:00,541 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:17:00,541 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:17:00,541 DEBUG [RS:0;jenkins-hbase4:41341] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a50683e to 127.0.0.1:61297 2023-07-12 18:17:00,541 DEBUG [RS:2;jenkins-hbase4:45233] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fa8686e to 127.0.0.1:61297 2023-07-12 18:17:00,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8f7311c23e57dcb89e171c537cff8d9a, disabling compactions & flushes 2023-07-12 18:17:00,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8e5f89a25d2209f833349b3fdabecf65, disabling compactions & flushes 2023-07-12 18:17:00,542 DEBUG [RS:0;jenkins-hbase4:41341] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:17:00,544 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 18:17:00,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:17:00,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:17:00,542 DEBUG [RS:2;jenkins-hbase4:45233] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:17:00,544 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. after waiting 0 ms 2023-07-12 18:17:00,544 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1478): Online Regions={8f7311c23e57dcb89e171c537cff8d9a=hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a.} 2023-07-12 18:17:00,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:17:00,545 INFO [RS:2;jenkins-hbase4:45233] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:17:00,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8e5f89a25d2209f833349b3fdabecf65 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 18:17:00,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. after waiting 0 ms 2023-07-12 18:17:00,545 INFO [RS:2;jenkins-hbase4:45233] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:17:00,545 INFO [RS:2;jenkins-hbase4:45233] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:17:00,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:17:00,545 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 18:17:00,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 8f7311c23e57dcb89e171c537cff8d9a 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 18:17:00,546 DEBUG [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1504): Waiting on 8f7311c23e57dcb89e171c537cff8d9a 2023-07-12 18:17:00,546 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 18:17:00,546 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 8e5f89a25d2209f833349b3fdabecf65=hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65.} 2023-07-12 18:17:00,547 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 18:17:00,547 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 18:17:00,547 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 18:17:00,547 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 18:17:00,547 DEBUG [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1504): Waiting on 1588230740, 8e5f89a25d2209f833349b3fdabecf65 2023-07-12 18:17:00,547 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 18:17:00,548 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 18:17:00,561 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:00,572 DEBUG [RS:1;jenkins-hbase4:39547] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs 2023-07-12 18:17:00,572 INFO [RS:1;jenkins-hbase4:39547] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39547%2C1689185653208:(num 1689185655453) 2023-07-12 18:17:00,572 DEBUG [RS:1;jenkins-hbase4:39547] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,572 INFO [RS:1;jenkins-hbase4:39547] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:00,577 INFO [RS:1;jenkins-hbase4:39547] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 18:17:00,579 INFO [RS:1;jenkins-hbase4:39547] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:17:00,579 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:00,579 INFO [RS:1;jenkins-hbase4:39547] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:17:00,579 INFO [RS:1;jenkins-hbase4:39547] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:17:00,581 INFO [RS:1;jenkins-hbase4:39547] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39547 2023-07-12 18:17:00,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/.tmp/info/270971e9894f483b803caa3fc1e1a559 2023-07-12 18:17:00,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/.tmp/l/9952d02b8f2443169791777b7d539ef4 2023-07-12 18:17:00,586 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/.tmp/info/8ff8b4870555417e8fd1cb369188cc4d 2023-07-12 18:17:00,589 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:00,590 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:17:00,590 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:00,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9952d02b8f2443169791777b7d539ef4 2023-07-12 18:17:00,590 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:17:00,590 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39547,1689185653208 2023-07-12 18:17:00,590 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:00,590 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:00,591 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39547,1689185653208] 2023-07-12 18:17:00,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/.tmp/info/270971e9894f483b803caa3fc1e1a559 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/info/270971e9894f483b803caa3fc1e1a559 2023-07-12 18:17:00,592 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39547,1689185653208; numProcessing=1 2023-07-12 18:17:00,592 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/.tmp/l/9952d02b8f2443169791777b7d539ef4 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/l/9952d02b8f2443169791777b7d539ef4 2023-07-12 18:17:00,592 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ff8b4870555417e8fd1cb369188cc4d 2023-07-12 18:17:00,594 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39547,1689185653208 already deleted, retry=false 2023-07-12 18:17:00,594 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39547,1689185653208 expired; onlineServers=2 2023-07-12 18:17:00,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/info/270971e9894f483b803caa3fc1e1a559, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 18:17:00,598 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 8f7311c23e57dcb89e171c537cff8d9a in 53ms, sequenceid=6, compaction requested=false 2023-07-12 18:17:00,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9952d02b8f2443169791777b7d539ef4 2023-07-12 18:17:00,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/l/9952d02b8f2443169791777b7d539ef4, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 18:17:00,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 8e5f89a25d2209f833349b3fdabecf65 in 60ms, sequenceid=18, compaction requested=false 2023-07-12 18:17:00,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/namespace/8f7311c23e57dcb89e171c537cff8d9a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 18:17:00,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,614 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:17:00,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8f7311c23e57dcb89e171c537cff8d9a: 2023-07-12 18:17:00,614 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689185656208.8f7311c23e57dcb89e171c537cff8d9a. 2023-07-12 18:17:00,616 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/.tmp/rep_barrier/31c21cec3bc84701a9cf04e5ad978c3c 2023-07-12 18:17:00,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/acl/8e5f89a25d2209f833349b3fdabecf65/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 18:17:00,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:17:00,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8e5f89a25d2209f833349b3fdabecf65: 2023-07-12 18:17:00,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689185656959.8e5f89a25d2209f833349b3fdabecf65. 2023-07-12 18:17:00,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31c21cec3bc84701a9cf04e5ad978c3c 2023-07-12 18:17:00,629 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:00,630 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:00,631 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/.tmp/table/e35535ff24534181a766d15623387282 2023-07-12 18:17:00,635 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e35535ff24534181a766d15623387282 2023-07-12 18:17:00,636 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/.tmp/info/8ff8b4870555417e8fd1cb369188cc4d as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/info/8ff8b4870555417e8fd1cb369188cc4d 2023-07-12 18:17:00,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8ff8b4870555417e8fd1cb369188cc4d 2023-07-12 18:17:00,640 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/info/8ff8b4870555417e8fd1cb369188cc4d, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 18:17:00,640 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/.tmp/rep_barrier/31c21cec3bc84701a9cf04e5ad978c3c as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/rep_barrier/31c21cec3bc84701a9cf04e5ad978c3c 2023-07-12 18:17:00,644 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 31c21cec3bc84701a9cf04e5ad978c3c 2023-07-12 18:17:00,645 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/rep_barrier/31c21cec3bc84701a9cf04e5ad978c3c, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 18:17:00,647 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/.tmp/table/e35535ff24534181a766d15623387282 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/table/e35535ff24534181a766d15623387282 2023-07-12 18:17:00,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e35535ff24534181a766d15623387282 2023-07-12 18:17:00,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/table/e35535ff24534181a766d15623387282, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 18:17:00,652 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 104ms, sequenceid=131, compaction requested=false 2023-07-12 18:17:00,664 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 18:17:00,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 18:17:00,665 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 18:17:00,666 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 18:17:00,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 18:17:00,666 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 18:17:00,692 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:00,692 INFO [RS:1;jenkins-hbase4:39547] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39547,1689185653208; zookeeper connection closed. 2023-07-12 18:17:00,693 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:39547-0x1015abe0af20002, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:00,693 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d3c5b4e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d3c5b4e 2023-07-12 18:17:00,746 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41341,1689185653145; all regions closed. 2023-07-12 18:17:00,748 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45233,1689185653260; all regions closed. 2023-07-12 18:17:00,753 DEBUG [RS:0;jenkins-hbase4:41341] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs 2023-07-12 18:17:00,753 INFO [RS:0;jenkins-hbase4:41341] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41341%2C1689185653145:(num 1689185655463) 2023-07-12 18:17:00,753 DEBUG [RS:0;jenkins-hbase4:41341] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,753 INFO [RS:0;jenkins-hbase4:41341] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:00,753 INFO [RS:0;jenkins-hbase4:41341] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:17:00,754 DEBUG [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs 2023-07-12 18:17:00,754 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:00,754 INFO [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45233%2C1689185653260.meta:.meta(num 1689185655811) 2023-07-12 18:17:00,754 INFO [RS:0;jenkins-hbase4:41341] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 18:17:00,754 INFO [RS:0;jenkins-hbase4:41341] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 18:17:00,754 INFO [RS:0;jenkins-hbase4:41341] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 18:17:00,755 INFO [RS:0;jenkins-hbase4:41341] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41341 2023-07-12 18:17:00,757 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:17:00,757 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41341,1689185653145 2023-07-12 18:17:00,758 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:00,759 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/WALs/jenkins-hbase4.apache.org,45233,1689185653260/jenkins-hbase4.apache.org%2C45233%2C1689185653260.1689185655454 not finished, retry = 0 2023-07-12 18:17:00,759 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41341,1689185653145] 2023-07-12 18:17:00,759 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41341,1689185653145; numProcessing=2 2023-07-12 18:17:00,761 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41341,1689185653145 already deleted, retry=false 2023-07-12 18:17:00,761 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,41341,1689185653145 expired; onlineServers=1 2023-07-12 18:17:00,859 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:00,860 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:41341-0x1015abe0af20001, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:00,860 INFO [RS:0;jenkins-hbase4:41341] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41341,1689185653145; zookeeper connection closed. 2023-07-12 18:17:00,860 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2fb1ec1b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2fb1ec1b 2023-07-12 18:17:00,862 DEBUG [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/oldWALs 2023-07-12 18:17:00,862 INFO [RS:2;jenkins-hbase4:45233] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45233%2C1689185653260:(num 1689185655454) 2023-07-12 18:17:00,862 DEBUG [RS:2;jenkins-hbase4:45233] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,862 INFO [RS:2;jenkins-hbase4:45233] regionserver.LeaseManager(133): Closed leases 2023-07-12 18:17:00,862 INFO [RS:2;jenkins-hbase4:45233] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-12 18:17:00,862 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:00,863 INFO [RS:2;jenkins-hbase4:45233] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45233 2023-07-12 18:17:00,866 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45233,1689185653260 2023-07-12 18:17:00,866 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 18:17:00,867 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45233,1689185653260] 2023-07-12 18:17:00,867 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45233,1689185653260; numProcessing=3 2023-07-12 18:17:00,868 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45233,1689185653260 already deleted, retry=false 2023-07-12 18:17:00,869 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,45233,1689185653260 expired; onlineServers=0 2023-07-12 18:17:00,869 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33521,1689185651624' ***** 2023-07-12 18:17:00,869 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 18:17:00,869 DEBUG [M:0;jenkins-hbase4:33521] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e13a843, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 18:17:00,869 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33521,1689185651624 2023-07-12 18:17:00,869 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33521,1689185651624; all regions closed. 2023-07-12 18:17:00,869 DEBUG [M:0;jenkins-hbase4:33521] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 18:17:00,869 DEBUG [M:0;jenkins-hbase4:33521] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 18:17:00,869 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 18:17:00,869 DEBUG [M:0;jenkins-hbase4:33521] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 18:17:00,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689185654903] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689185654903,5,FailOnTimeoutGroup] 2023-07-12 18:17:00,869 INFO [M:0;jenkins-hbase4:33521] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 18:17:00,869 INFO [M:0;jenkins-hbase4:33521] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 18:17:00,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689185654901] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689185654901,5,FailOnTimeoutGroup] 2023-07-12 18:17:00,870 INFO [M:0;jenkins-hbase4:33521] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-12 18:17:00,870 DEBUG [M:0;jenkins-hbase4:33521] master.HMaster(1512): Stopping service threads 2023-07-12 18:17:00,870 INFO [M:0;jenkins-hbase4:33521] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 18:17:00,870 ERROR [M:0;jenkins-hbase4:33521] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT 2023-07-12 18:17:00,870 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 18:17:00,870 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 18:17:00,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 18:17:00,871 INFO [M:0;jenkins-hbase4:33521] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 18:17:00,871 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 18:17:00,871 DEBUG [M:0;jenkins-hbase4:33521] zookeeper.ZKUtil(398): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 18:17:00,871 WARN [M:0;jenkins-hbase4:33521] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 18:17:00,871 INFO [M:0;jenkins-hbase4:33521] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 18:17:00,871 INFO [M:0;jenkins-hbase4:33521] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 18:17:00,872 DEBUG [M:0;jenkins-hbase4:33521] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 18:17:00,872 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:00,872 DEBUG [M:0;jenkins-hbase4:33521] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:00,872 DEBUG [M:0;jenkins-hbase4:33521] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 18:17:00,872 DEBUG [M:0;jenkins-hbase4:33521] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:00,872 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.37 KB heapSize=449.61 KB 2023-07-12 18:17:00,893 INFO [M:0;jenkins-hbase4:33521] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.37 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b8c7de5ce354244bbc13f270a0ecda4 2023-07-12 18:17:00,898 INFO [M:0;jenkins-hbase4:33521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b8c7de5ce354244bbc13f270a0ecda4 2023-07-12 18:17:00,899 DEBUG [M:0;jenkins-hbase4:33521] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1b8c7de5ce354244bbc13f270a0ecda4 as hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b8c7de5ce354244bbc13f270a0ecda4 2023-07-12 18:17:00,903 INFO [M:0;jenkins-hbase4:33521] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b8c7de5ce354244bbc13f270a0ecda4 2023-07-12 18:17:00,903 INFO [M:0;jenkins-hbase4:33521] regionserver.HStore(1080): Added hdfs://localhost:43721/user/jenkins/test-data/c480e64c-318d-358a-d14d-a3501e16df4a/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1b8c7de5ce354244bbc13f270a0ecda4, entries=119, sequenceid=899, filesize=28.4 K 2023-07-12 18:17:00,904 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegion(2948): Finished flush of dataSize ~373.37 KB/382330, heapSize ~449.59 KB/460384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=899, compaction requested=false 2023-07-12 18:17:00,906 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 18:17:00,906 DEBUG [M:0;jenkins-hbase4:33521] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 18:17:00,909 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 18:17:00,909 INFO [M:0;jenkins-hbase4:33521] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 18:17:00,910 INFO [M:0;jenkins-hbase4:33521] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33521 2023-07-12 18:17:00,912 DEBUG [M:0;jenkins-hbase4:33521] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33521,1689185651624 already deleted, retry=false 2023-07-12 18:17:00,968 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:00,968 INFO [RS:2;jenkins-hbase4:45233] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45233,1689185653260; zookeeper connection closed. 2023-07-12 18:17:00,968 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): regionserver:45233-0x1015abe0af20003, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:00,968 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7afbdea] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7afbdea 2023-07-12 18:17:00,968 INFO [Listener at jenkins-hbase4.apache.org/36331] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 18:17:01,068 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:01,068 INFO [M:0;jenkins-hbase4:33521] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33521,1689185651624; zookeeper connection closed. 2023-07-12 18:17:01,068 DEBUG [Listener at localhost/43601-EventThread] zookeeper.ZKWatcher(600): master:33521-0x1015abe0af20000, quorum=127.0.0.1:61297, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 18:17:01,070 WARN [Listener at jenkins-hbase4.apache.org/36331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:17:01,075 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:01,178 WARN [BP-1352234892-172.31.14.131-1689185647144 heartbeating to localhost/127.0.0.1:43721] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:17:01,178 WARN [BP-1352234892-172.31.14.131-1689185647144 heartbeating to localhost/127.0.0.1:43721] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1352234892-172.31.14.131-1689185647144 (Datanode Uuid d11e8186-caeb-4f53-83a8-282490990970) service to localhost/127.0.0.1:43721 2023-07-12 18:17:01,180 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data5/current/BP-1352234892-172.31.14.131-1689185647144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:01,181 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data6/current/BP-1352234892-172.31.14.131-1689185647144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:01,182 WARN [Listener at jenkins-hbase4.apache.org/36331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:17:01,195 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:01,223 WARN [BP-1352234892-172.31.14.131-1689185647144 heartbeating to localhost/127.0.0.1:43721] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1352234892-172.31.14.131-1689185647144 (Datanode Uuid 2a3be9cf-285f-4a59-9f46-1f636f0c6f40) service to localhost/127.0.0.1:43721 2023-07-12 18:17:01,224 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data3/current/BP-1352234892-172.31.14.131-1689185647144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:01,224 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data4/current/BP-1352234892-172.31.14.131-1689185647144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:01,299 WARN [Listener at jenkins-hbase4.apache.org/36331] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 18:17:01,303 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:01,406 WARN [BP-1352234892-172.31.14.131-1689185647144 heartbeating to localhost/127.0.0.1:43721] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 18:17:01,406 WARN [BP-1352234892-172.31.14.131-1689185647144 heartbeating to localhost/127.0.0.1:43721] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1352234892-172.31.14.131-1689185647144 (Datanode Uuid 51da195b-f8b8-4808-9241-188c332d1ba8) service to localhost/127.0.0.1:43721 2023-07-12 18:17:01,407 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data1/current/BP-1352234892-172.31.14.131-1689185647144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:01,407 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/2a9e03f8-7067-1d37-1ece-9337a5d44a18/cluster_3464924e-3709-ebf5-70e1-643dd3cc4bcb/dfs/data/data2/current/BP-1352234892-172.31.14.131-1689185647144] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 18:17:01,428 INFO [Listener at jenkins-hbase4.apache.org/36331] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 18:17:01,553 INFO [Listener at jenkins-hbase4.apache.org/36331] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 18:17:01,640 INFO [Listener at jenkins-hbase4.apache.org/36331] hbase.HBaseTestingUtility(1293): Minicluster is down