2023-07-19 13:10:25,018 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-19 13:10:25,274 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99 2023-07-19 13:10:25,275 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-19 13:10:25,313 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-19 13:10:25,645 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-19 13:10:25,646 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100, deleteOnExit=true 2023-07-19 13:10:25,646 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-19 13:10:25,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/test.cache.data in system properties and HBase conf 2023-07-19 13:10:25,647 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 13:10:25,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop.log.dir in system properties and HBase conf 2023-07-19 13:10:25,648 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 13:10:25,649 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 13:10:25,649 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 13:10:26,124 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-19 13:10:26,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:26,131 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:26,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 13:10:26,132 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:26,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 13:10:26,133 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 13:10:26,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:26,134 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:26,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 13:10:26,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/nfs.dump.dir in system properties and HBase conf 2023-07-19 13:10:26,135 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir in system properties and HBase conf 2023-07-19 13:10:26,136 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:26,136 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 13:10:26,137 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-19 13:10:26,787 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 13:10:26,792 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 13:10:27,155 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-19 13:10:27,400 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-19 13:10:27,418 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:27,462 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:27,500 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_localhost_38185_hdfs____3d9z4j/webapp 2023-07-19 13:10:27,654 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38185 2023-07-19 13:10:27,666 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-19 13:10:27,666 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-19 13:10:28,247 WARN [Listener at localhost/42099] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:28,353 WARN [Listener at localhost/42099] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 13:10:28,382 WARN [Listener at localhost/42099] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:28,391 INFO [Listener at localhost/42099] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:28,401 INFO [Listener at localhost/42099] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_localhost_39691_datanode____.fqmyr5/webapp 2023-07-19 13:10:28,586 INFO [Listener at localhost/42099] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39691 2023-07-19 13:10:29,086 WARN [Listener at localhost/39929] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:29,123 WARN [Listener at localhost/39929] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 13:10:29,129 WARN [Listener at localhost/39929] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:29,131 INFO [Listener at localhost/39929] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:29,143 INFO [Listener at localhost/39929] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_localhost_37349_datanode____d85bv/webapp 2023-07-19 13:10:29,275 INFO [Listener at localhost/39929] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37349 2023-07-19 13:10:29,290 WARN [Listener at localhost/43741] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:29,358 WARN [Listener at localhost/43741] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-19 13:10:29,363 WARN [Listener at localhost/43741] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:29,366 INFO [Listener at localhost/43741] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:29,382 INFO [Listener at localhost/43741] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_localhost_33183_datanode____.k1xjm5/webapp 2023-07-19 13:10:29,579 INFO [Listener at localhost/43741] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33183 2023-07-19 13:10:29,606 WARN [Listener at localhost/34677] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-19 13:10:29,915 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb544cda18e8e8749: Processing first storage report for DS-c4bae620-18cb-4f7c-b090-b81c37747c1e from datanode 05ca398d-af95-46f7-884d-5e417193760d 2023-07-19 13:10:29,917 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb544cda18e8e8749: from storage DS-c4bae620-18cb-4f7c-b090-b81c37747c1e node DatanodeRegistration(127.0.0.1:39327, datanodeUuid=05ca398d-af95-46f7-884d-5e417193760d, infoPort=45119, infoSecurePort=0, ipcPort=34677, storageInfo=lv=-57;cid=testClusterID;nsid=470374110;c=1689772226902), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-19 13:10:29,917 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18f242d0761a80a9: Processing first storage report for DS-cea132fd-cef2-489b-9e74-50ae291ed71b from datanode 1d231ea3-2572-46de-81db-23d764146d99 2023-07-19 13:10:29,917 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18f242d0761a80a9: from storage DS-cea132fd-cef2-489b-9e74-50ae291ed71b node DatanodeRegistration(127.0.0.1:33679, datanodeUuid=1d231ea3-2572-46de-81db-23d764146d99, infoPort=40639, infoSecurePort=0, ipcPort=43741, storageInfo=lv=-57;cid=testClusterID;nsid=470374110;c=1689772226902), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:29,918 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb544cda18e8e8749: Processing first storage report for DS-7bb69ea9-8df1-48fa-94b0-2a958ed8a7bc from datanode 05ca398d-af95-46f7-884d-5e417193760d 2023-07-19 13:10:29,918 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb544cda18e8e8749: from storage DS-7bb69ea9-8df1-48fa-94b0-2a958ed8a7bc node DatanodeRegistration(127.0.0.1:39327, datanodeUuid=05ca398d-af95-46f7-884d-5e417193760d, infoPort=45119, infoSecurePort=0, ipcPort=34677, storageInfo=lv=-57;cid=testClusterID;nsid=470374110;c=1689772226902), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:29,918 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x18f242d0761a80a9: Processing first storage report for DS-4d0d1e5a-b02c-485d-8bf2-ed390355fb43 from datanode 1d231ea3-2572-46de-81db-23d764146d99 2023-07-19 13:10:29,918 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x18f242d0761a80a9: from storage DS-4d0d1e5a-b02c-485d-8bf2-ed390355fb43 node DatanodeRegistration(127.0.0.1:33679, datanodeUuid=1d231ea3-2572-46de-81db-23d764146d99, infoPort=40639, infoSecurePort=0, ipcPort=43741, storageInfo=lv=-57;cid=testClusterID;nsid=470374110;c=1689772226902), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:29,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6fb978b27e38098a: Processing first storage report for DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82 from datanode 5e3a56dd-a05e-41a6-a29e-c88f444d4a2f 2023-07-19 13:10:29,922 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6fb978b27e38098a: from storage DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82 node DatanodeRegistration(127.0.0.1:36217, datanodeUuid=5e3a56dd-a05e-41a6-a29e-c88f444d4a2f, infoPort=33921, infoSecurePort=0, ipcPort=39929, storageInfo=lv=-57;cid=testClusterID;nsid=470374110;c=1689772226902), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-19 13:10:29,922 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6fb978b27e38098a: Processing first storage report for DS-fa4b9f05-5320-4641-a738-eca986348a7e from datanode 5e3a56dd-a05e-41a6-a29e-c88f444d4a2f 2023-07-19 13:10:29,922 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6fb978b27e38098a: from storage DS-fa4b9f05-5320-4641-a738-eca986348a7e node DatanodeRegistration(127.0.0.1:36217, datanodeUuid=5e3a56dd-a05e-41a6-a29e-c88f444d4a2f, infoPort=33921, infoSecurePort=0, ipcPort=39929, storageInfo=lv=-57;cid=testClusterID;nsid=470374110;c=1689772226902), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-19 13:10:30,209 DEBUG [Listener at localhost/34677] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99 2023-07-19 13:10:30,303 INFO [Listener at localhost/34677] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/zookeeper_0, clientPort=64397, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-19 13:10:30,331 INFO [Listener at localhost/34677] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64397 2023-07-19 13:10:30,344 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:30,347 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:31,105 INFO [Listener at localhost/34677] util.FSUtils(471): Created version file at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f with version=8 2023-07-19 13:10:31,105 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/hbase-staging 2023-07-19 13:10:31,470 INFO [Listener at localhost/34677] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-19 13:10:32,149 INFO [Listener at localhost/34677] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:32,186 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,186 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,187 INFO [Listener at localhost/34677] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:32,187 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,187 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:32,345 INFO [Listener at localhost/34677] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:32,441 DEBUG [Listener at localhost/34677] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-19 13:10:32,543 INFO [Listener at localhost/34677] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43411 2023-07-19 13:10:32,562 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,565 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,591 INFO [Listener at localhost/34677] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43411 connecting to ZooKeeper ensemble=127.0.0.1:64397 2023-07-19 13:10:32,652 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:434110x0, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:32,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43411-0x1017db489880000 connected 2023-07-19 13:10:32,713 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:32,714 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:32,730 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:32,742 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43411 2023-07-19 13:10:32,743 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43411 2023-07-19 13:10:32,750 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43411 2023-07-19 13:10:32,755 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43411 2023-07-19 13:10:32,756 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43411 2023-07-19 13:10:32,764 INFO [Listener at localhost/34677] master.HMaster(444): hbase.rootdir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, hbase.cluster.distributed=false 2023-07-19 13:10:32,854 INFO [Listener at localhost/34677] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:32,855 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,855 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,855 INFO [Listener at localhost/34677] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:32,855 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,856 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:32,862 INFO [Listener at localhost/34677] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:32,875 INFO [Listener at localhost/34677] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39417 2023-07-19 13:10:32,879 INFO [Listener at localhost/34677] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 13:10:32,890 DEBUG [Listener at localhost/34677] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 13:10:32,892 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,895 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,898 INFO [Listener at localhost/34677] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39417 connecting to ZooKeeper ensemble=127.0.0.1:64397 2023-07-19 13:10:32,906 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:394170x0, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:32,907 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:394170x0, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:32,911 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39417-0x1017db489880001 connected 2023-07-19 13:10:32,913 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:32,915 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:32,922 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39417 2023-07-19 13:10:32,923 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39417 2023-07-19 13:10:32,923 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39417 2023-07-19 13:10:32,930 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39417 2023-07-19 13:10:32,930 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39417 2023-07-19 13:10:32,950 INFO [Listener at localhost/34677] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:32,950 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,950 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,951 INFO [Listener at localhost/34677] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:32,951 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:32,951 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:32,951 INFO [Listener at localhost/34677] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:32,954 INFO [Listener at localhost/34677] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33135 2023-07-19 13:10:32,955 INFO [Listener at localhost/34677] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 13:10:32,966 DEBUG [Listener at localhost/34677] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 13:10:32,968 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,976 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:32,979 INFO [Listener at localhost/34677] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33135 connecting to ZooKeeper ensemble=127.0.0.1:64397 2023-07-19 13:10:32,987 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:331350x0, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:32,988 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:331350x0, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:32,990 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:331350x0, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:32,991 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:331350x0, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:33,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33135-0x1017db489880002 connected 2023-07-19 13:10:33,004 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33135 2023-07-19 13:10:33,005 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33135 2023-07-19 13:10:33,005 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33135 2023-07-19 13:10:33,006 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33135 2023-07-19 13:10:33,010 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33135 2023-07-19 13:10:33,029 INFO [Listener at localhost/34677] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-19 13:10:33,029 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,029 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,029 INFO [Listener at localhost/34677] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-19 13:10:33,029 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-19 13:10:33,030 INFO [Listener at localhost/34677] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-19 13:10:33,030 INFO [Listener at localhost/34677] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-19 13:10:33,032 INFO [Listener at localhost/34677] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34931 2023-07-19 13:10:33,033 INFO [Listener at localhost/34677] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-19 13:10:33,047 DEBUG [Listener at localhost/34677] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-19 13:10:33,049 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,051 INFO [Listener at localhost/34677] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,052 INFO [Listener at localhost/34677] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34931 connecting to ZooKeeper ensemble=127.0.0.1:64397 2023-07-19 13:10:33,071 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:349310x0, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-19 13:10:33,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34931-0x1017db489880003 connected 2023-07-19 13:10:33,073 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:10:33,074 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:10:33,076 DEBUG [Listener at localhost/34677] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-19 13:10:33,083 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34931 2023-07-19 13:10:33,083 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34931 2023-07-19 13:10:33,084 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34931 2023-07-19 13:10:33,087 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34931 2023-07-19 13:10:33,090 DEBUG [Listener at localhost/34677] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34931 2023-07-19 13:10:33,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:33,105 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 13:10:33,107 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:33,131 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,131 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,131 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,131 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-19 13:10:33,132 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:33,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 13:10:33,136 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43411,1689772231278 from backup master directory 2023-07-19 13:10:33,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-19 13:10:33,141 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:33,141 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-19 13:10:33,142 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:33,142 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:33,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-19 13:10:33,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-19 13:10:33,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/hbase.id with ID: 7b4f2ee1-9c5b-4f36-8df2-9638bc619d43 2023-07-19 13:10:33,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-19 13:10:33,346 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:33,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3f834d70 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:33,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41eeb1e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:33,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:33,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-19 13:10:33,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-19 13:10:33,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-19 13:10:33,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 13:10:33,509 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-19 13:10:33,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:33,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store-tmp 2023-07-19 13:10:33,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:33,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 13:10:33,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 13:10:33,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:10:33,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 13:10:33,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/WALs/jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:33,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43411%2C1689772231278, suffix=, logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/WALs/jenkins-hbase4.apache.org,43411,1689772231278, archiveDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/oldWALs, maxLogs=10 2023-07-19 13:10:33,716 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK] 2023-07-19 13:10:33,716 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK] 2023-07-19 13:10:33,716 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK] 2023-07-19 13:10:33,726 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-19 13:10:33,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/WALs/jenkins-hbase4.apache.org,43411,1689772231278/jenkins-hbase4.apache.org%2C43411%2C1689772231278.1689772233662 2023-07-19 13:10:33,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK], DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK]] 2023-07-19 13:10:33,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:33,841 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:33,845 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:33,846 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:33,938 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:33,947 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-19 13:10:33,986 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-19 13:10:34,003 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,027 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-19 13:10:34,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:34,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65857959, jitterRate=-0.018639937043190002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:34,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 13:10:34,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-19 13:10:34,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-19 13:10:34,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-19 13:10:34,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-19 13:10:34,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-19 13:10:34,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-19 13:10:34,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-19 13:10:34,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-19 13:10:34,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-19 13:10:34,174 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-19 13:10:34,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-19 13:10:34,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-19 13:10:34,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-19 13:10:34,191 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-19 13:10:34,194 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-19 13:10:34,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-19 13:10:34,217 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-19 13:10:34,224 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,224 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,224 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,224 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-19 13:10:34,224 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43411,1689772231278, sessionid=0x1017db489880000, setting cluster-up flag (Was=false) 2023-07-19 13:10:34,249 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-19 13:10:34,261 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:34,268 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:34,275 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-19 13:10:34,276 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:34,280 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp 2023-07-19 13:10:34,298 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(951): ClusterId : 7b4f2ee1-9c5b-4f36-8df2-9638bc619d43 2023-07-19 13:10:34,301 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(951): ClusterId : 7b4f2ee1-9c5b-4f36-8df2-9638bc619d43 2023-07-19 13:10:34,300 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(951): ClusterId : 7b4f2ee1-9c5b-4f36-8df2-9638bc619d43 2023-07-19 13:10:34,308 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 13:10:34,308 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 13:10:34,308 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-19 13:10:34,318 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 13:10:34,319 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 13:10:34,318 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-19 13:10:34,319 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 13:10:34,319 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 13:10:34,319 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-19 13:10:34,323 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 13:10:34,325 DEBUG [RS:1;jenkins-hbase4:33135] zookeeper.ReadOnlyZKClient(139): Connect 0x5e4033d5 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:34,326 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 13:10:34,330 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-19 13:10:34,335 DEBUG [RS:2;jenkins-hbase4:34931] zookeeper.ReadOnlyZKClient(139): Connect 0x76486012 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:34,335 DEBUG [RS:0;jenkins-hbase4:39417] zookeeper.ReadOnlyZKClient(139): Connect 0x7a526596 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:34,357 DEBUG [RS:1;jenkins-hbase4:33135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5087c66d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:34,363 DEBUG [RS:1;jenkins-hbase4:33135] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54b858a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:10:34,370 DEBUG [RS:0;jenkins-hbase4:39417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@749584ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:34,371 DEBUG [RS:0;jenkins-hbase4:39417] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70aa0ee6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:10:34,396 DEBUG [RS:2;jenkins-hbase4:34931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@788f80ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:34,396 DEBUG [RS:2;jenkins-hbase4:34931] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cb00b62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:10:34,424 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34931 2023-07-19 13:10:34,424 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33135 2023-07-19 13:10:34,432 INFO [RS:2;jenkins-hbase4:34931] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 13:10:34,432 INFO [RS:2;jenkins-hbase4:34931] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 13:10:34,432 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39417 2023-07-19 13:10:34,432 INFO [RS:0;jenkins-hbase4:39417] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 13:10:34,433 INFO [RS:0;jenkins-hbase4:39417] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 13:10:34,433 INFO [RS:1;jenkins-hbase4:33135] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-19 13:10:34,442 INFO [RS:1;jenkins-hbase4:33135] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-19 13:10:34,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-19 13:10:34,453 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 13:10:34,453 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 13:10:34,453 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-19 13:10:34,454 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,456 INFO [RS:2;jenkins-hbase4:34931] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,455 INFO [RS:0;jenkins-hbase4:39417] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,456 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 13:10:34,456 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-19 13:10:34,456 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 13:10:34,455 INFO [RS:1;jenkins-hbase4:33135] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:34,458 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1022): About to register with Master. 2023-07-19 13:10:34,460 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43411,1689772231278 with isa=jenkins-hbase4.apache.org/172.31.14.131:34931, startcode=1689772233028 2023-07-19 13:10:34,460 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43411,1689772231278 with isa=jenkins-hbase4.apache.org/172.31.14.131:33135, startcode=1689772232949 2023-07-19 13:10:34,462 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43411,1689772231278 with isa=jenkins-hbase4.apache.org/172.31.14.131:39417, startcode=1689772232852 2023-07-19 13:10:34,486 DEBUG [RS:2;jenkins-hbase4:34931] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 13:10:34,488 DEBUG [RS:0;jenkins-hbase4:39417] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 13:10:34,487 DEBUG [RS:1;jenkins-hbase4:33135] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-19 13:10:34,562 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52365, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 13:10:34,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-19 13:10:34,562 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48103, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 13:10:34,562 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39519, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-19 13:10:34,573 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43411] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 13:10:34,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-19 13:10:34,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-19 13:10:34,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:34,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,582 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43411] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 13:10:34,582 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43411] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-19 13:10:34,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689772264585 2023-07-19 13:10:34,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-19 13:10:34,599 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 13:10:34,599 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-19 13:10:34,603 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-19 13:10:34,607 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:34,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-19 13:10:34,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-19 13:10:34,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-19 13:10:34,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-19 13:10:34,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,616 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 13:10:34,616 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 13:10:34,616 WARN [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 13:10:34,616 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(2830): Master is not running yet 2023-07-19 13:10:34,616 WARN [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 13:10:34,617 WARN [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-19 13:10:34,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-19 13:10:34,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-19 13:10:34,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-19 13:10:34,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-19 13:10:34,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-19 13:10:34,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689772234625,5,FailOnTimeoutGroup] 2023-07-19 13:10:34,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689772234625,5,FailOnTimeoutGroup] 2023-07-19 13:10:34,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-19 13:10:34,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,682 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:34,684 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:34,684 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:10:34,718 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43411,1689772231278 with isa=jenkins-hbase4.apache.org/172.31.14.131:39417, startcode=1689772232852 2023-07-19 13:10:34,718 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43411,1689772231278 with isa=jenkins-hbase4.apache.org/172.31.14.131:34931, startcode=1689772233028 2023-07-19 13:10:34,718 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43411,1689772231278 with isa=jenkins-hbase4.apache.org/172.31.14.131:33135, startcode=1689772232949 2023-07-19 13:10:34,738 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43411] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:34,750 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43411] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:34,751 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:10:34,751 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42099 2023-07-19 13:10:34,751 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 13:10:34,752 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43411] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:34,753 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:10:34,753 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42099 2023-07-19 13:10:34,754 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 13:10:34,754 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:10:34,754 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42099 2023-07-19 13:10:34,754 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-19 13:10:34,757 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:34,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 13:10:34,763 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/info 2023-07-19 13:10:34,763 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:10:34,763 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 13:10:34,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,765 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 13:10:34,766 DEBUG [RS:1;jenkins-hbase4:33135] zookeeper.ZKUtil(162): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:34,766 DEBUG [RS:2;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:34,766 DEBUG [RS:0;jenkins-hbase4:39417] zookeeper.ZKUtil(162): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:34,767 WARN [RS:1;jenkins-hbase4:33135] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:34,767 INFO [RS:1;jenkins-hbase4:33135] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:34,767 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:34,767 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33135,1689772232949] 2023-07-19 13:10:34,768 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34931,1689772233028] 2023-07-19 13:10:34,768 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39417,1689772232852] 2023-07-19 13:10:34,767 WARN [RS:2;jenkins-hbase4:34931] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:34,767 WARN [RS:0;jenkins-hbase4:39417] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-19 13:10:34,776 INFO [RS:2;jenkins-hbase4:34931] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:34,776 INFO [RS:0;jenkins-hbase4:39417] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:34,777 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:34,777 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:34,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/rep_barrier 2023-07-19 13:10:34,780 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 13:10:34,781 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,781 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 13:10:34,791 DEBUG [RS:1;jenkins-hbase4:33135] zookeeper.ZKUtil(162): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:34,796 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/table 2023-07-19 13:10:34,797 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 13:10:34,799 DEBUG [RS:1;jenkins-hbase4:33135] zookeeper.ZKUtil(162): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:34,799 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:34,802 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740 2023-07-19 13:10:34,802 DEBUG [RS:1;jenkins-hbase4:33135] zookeeper.ZKUtil(162): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:34,802 DEBUG [RS:2;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:34,802 DEBUG [RS:0;jenkins-hbase4:39417] zookeeper.ZKUtil(162): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:34,803 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740 2023-07-19 13:10:34,803 DEBUG [RS:2;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:34,804 DEBUG [RS:0;jenkins-hbase4:39417] zookeeper.ZKUtil(162): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:34,804 DEBUG [RS:2;jenkins-hbase4:34931] zookeeper.ZKUtil(162): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:34,804 DEBUG [RS:0;jenkins-hbase4:39417] zookeeper.ZKUtil(162): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:34,814 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 13:10:34,816 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 13:10:34,817 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 13:10:34,818 DEBUG [RS:0;jenkins-hbase4:39417] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 13:10:34,822 DEBUG [RS:1;jenkins-hbase4:33135] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-19 13:10:34,823 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:34,824 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58907144, jitterRate=-0.1222151517868042}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 13:10:34,824 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 13:10:34,824 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 13:10:34,824 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 13:10:34,824 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 13:10:34,824 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 13:10:34,824 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 13:10:34,826 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 13:10:34,826 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 13:10:34,830 INFO [RS:1;jenkins-hbase4:33135] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 13:10:34,830 INFO [RS:2;jenkins-hbase4:34931] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 13:10:34,830 INFO [RS:0;jenkins-hbase4:39417] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-19 13:10:34,833 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-19 13:10:34,834 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-19 13:10:34,847 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-19 13:10:34,875 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-19 13:10:34,877 INFO [RS:0;jenkins-hbase4:39417] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 13:10:34,879 INFO [RS:2;jenkins-hbase4:34931] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 13:10:34,895 INFO [RS:1;jenkins-hbase4:33135] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-19 13:10:34,900 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-19 13:10:34,903 INFO [RS:2;jenkins-hbase4:34931] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 13:10:34,903 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,904 INFO [RS:1;jenkins-hbase4:33135] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 13:10:34,910 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 13:10:34,905 INFO [RS:0;jenkins-hbase4:39417] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-19 13:10:34,911 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,910 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,911 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 13:10:34,919 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-19 13:10:34,928 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,928 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,928 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,929 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,929 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,929 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,929 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,929 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:34,930 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,930 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:34,931 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-19 13:10:34,931 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:2;jenkins-hbase4:34931] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,931 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,932 DEBUG [RS:0;jenkins-hbase4:39417] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,932 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,932 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,932 DEBUG [RS:1;jenkins-hbase4:33135] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-19 13:10:34,932 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,933 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,940 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,940 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,940 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,947 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,947 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,947 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,961 INFO [RS:2;jenkins-hbase4:34931] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 13:10:34,965 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34931,1689772233028-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:34,979 INFO [RS:1;jenkins-hbase4:33135] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 13:10:34,981 INFO [RS:0;jenkins-hbase4:39417] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-19 13:10:35,000 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33135,1689772232949-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,000 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39417,1689772232852-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,029 INFO [RS:0;jenkins-hbase4:39417] regionserver.Replication(203): jenkins-hbase4.apache.org,39417,1689772232852 started 2023-07-19 13:10:35,029 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39417,1689772232852, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39417, sessionid=0x1017db489880001 2023-07-19 13:10:35,029 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 13:10:35,030 DEBUG [RS:0;jenkins-hbase4:39417] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:35,030 DEBUG [RS:0;jenkins-hbase4:39417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39417,1689772232852' 2023-07-19 13:10:35,030 DEBUG [RS:0;jenkins-hbase4:39417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 13:10:35,030 INFO [RS:2;jenkins-hbase4:34931] regionserver.Replication(203): jenkins-hbase4.apache.org,34931,1689772233028 started 2023-07-19 13:10:35,030 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34931,1689772233028, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34931, sessionid=0x1017db489880003 2023-07-19 13:10:35,030 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 13:10:35,030 DEBUG [RS:2;jenkins-hbase4:34931] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:35,032 DEBUG [RS:2;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34931,1689772233028' 2023-07-19 13:10:35,033 DEBUG [RS:2;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 13:10:35,034 DEBUG [RS:2;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 13:10:35,034 DEBUG [RS:0;jenkins-hbase4:39417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 13:10:35,035 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 13:10:35,035 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 13:10:35,035 DEBUG [RS:0;jenkins-hbase4:39417] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:35,035 DEBUG [RS:0;jenkins-hbase4:39417] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39417,1689772232852' 2023-07-19 13:10:35,035 DEBUG [RS:0;jenkins-hbase4:39417] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:35,035 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 13:10:35,035 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 13:10:35,035 DEBUG [RS:2;jenkins-hbase4:34931] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:35,036 DEBUG [RS:2;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34931,1689772233028' 2023-07-19 13:10:35,036 DEBUG [RS:2;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:35,037 DEBUG [RS:2;jenkins-hbase4:34931] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:35,037 INFO [RS:1;jenkins-hbase4:33135] regionserver.Replication(203): jenkins-hbase4.apache.org,33135,1689772232949 started 2023-07-19 13:10:35,037 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33135,1689772232949, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33135, sessionid=0x1017db489880002 2023-07-19 13:10:35,037 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-19 13:10:35,037 DEBUG [RS:1;jenkins-hbase4:33135] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:35,037 DEBUG [RS:1;jenkins-hbase4:33135] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33135,1689772232949' 2023-07-19 13:10:35,037 DEBUG [RS:1;jenkins-hbase4:33135] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-19 13:10:35,038 DEBUG [RS:0;jenkins-hbase4:39417] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:35,038 DEBUG [RS:1;jenkins-hbase4:33135] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-19 13:10:35,038 DEBUG [RS:2;jenkins-hbase4:34931] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 13:10:35,039 INFO [RS:2;jenkins-hbase4:34931] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 13:10:35,039 INFO [RS:2;jenkins-hbase4:34931] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 13:10:35,040 DEBUG [RS:0;jenkins-hbase4:39417] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 13:10:35,040 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-19 13:10:35,040 INFO [RS:0;jenkins-hbase4:39417] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 13:10:35,041 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-19 13:10:35,041 INFO [RS:0;jenkins-hbase4:39417] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 13:10:35,041 DEBUG [RS:1;jenkins-hbase4:33135] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:35,041 DEBUG [RS:1;jenkins-hbase4:33135] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33135,1689772232949' 2023-07-19 13:10:35,042 DEBUG [RS:1;jenkins-hbase4:33135] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:35,042 DEBUG [RS:1;jenkins-hbase4:33135] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:35,043 DEBUG [RS:1;jenkins-hbase4:33135] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-19 13:10:35,043 INFO [RS:1;jenkins-hbase4:33135] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-19 13:10:35,043 INFO [RS:1;jenkins-hbase4:33135] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-19 13:10:35,054 DEBUG [jenkins-hbase4:43411] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-19 13:10:35,061 DEBUG [jenkins-hbase4:43411] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:35,068 DEBUG [jenkins-hbase4:43411] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:35,068 DEBUG [jenkins-hbase4:43411] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:35,068 DEBUG [jenkins-hbase4:43411] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:35,068 DEBUG [jenkins-hbase4:43411] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:35,072 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34931,1689772233028, state=OPENING 2023-07-19 13:10:35,081 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-19 13:10:35,083 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:35,085 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 13:10:35,091 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:10:35,159 INFO [RS:1;jenkins-hbase4:33135] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33135%2C1689772232949, suffix=, logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,33135,1689772232949, archiveDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs, maxLogs=32 2023-07-19 13:10:35,162 INFO [RS:0;jenkins-hbase4:39417] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39417%2C1689772232852, suffix=, logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,39417,1689772232852, archiveDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs, maxLogs=32 2023-07-19 13:10:35,173 INFO [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34931%2C1689772233028, suffix=, logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,34931,1689772233028, archiveDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs, maxLogs=32 2023-07-19 13:10:35,212 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK] 2023-07-19 13:10:35,212 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK] 2023-07-19 13:10:35,212 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK] 2023-07-19 13:10:35,216 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK] 2023-07-19 13:10:35,216 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK] 2023-07-19 13:10:35,228 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK] 2023-07-19 13:10:35,230 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK] 2023-07-19 13:10:35,233 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK] 2023-07-19 13:10:35,233 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK] 2023-07-19 13:10:35,243 INFO [RS:1;jenkins-hbase4:33135] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,33135,1689772232949/jenkins-hbase4.apache.org%2C33135%2C1689772232949.1689772235163 2023-07-19 13:10:35,243 INFO [RS:0;jenkins-hbase4:39417] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,39417,1689772232852/jenkins-hbase4.apache.org%2C39417%2C1689772232852.1689772235164 2023-07-19 13:10:35,247 DEBUG [RS:0;jenkins-hbase4:39417] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK], DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK]] 2023-07-19 13:10:35,248 DEBUG [RS:1;jenkins-hbase4:33135] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK], DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK]] 2023-07-19 13:10:35,248 INFO [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,34931,1689772233028/jenkins-hbase4.apache.org%2C34931%2C1689772233028.1689772235174 2023-07-19 13:10:35,248 DEBUG [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK], DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK]] 2023-07-19 13:10:35,337 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:35,341 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:10:35,344 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39310, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:10:35,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-19 13:10:35,365 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-19 13:10:35,369 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34931%2C1689772233028.meta, suffix=.meta, logDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,34931,1689772233028, archiveDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs, maxLogs=32 2023-07-19 13:10:35,416 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK] 2023-07-19 13:10:35,417 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK] 2023-07-19 13:10:35,421 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK] 2023-07-19 13:10:35,432 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/WALs/jenkins-hbase4.apache.org,34931,1689772233028/jenkins-hbase4.apache.org%2C34931%2C1689772233028.meta.1689772235371.meta 2023-07-19 13:10:35,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39327,DS-c4bae620-18cb-4f7c-b090-b81c37747c1e,DISK], DatanodeInfoWithStorage[127.0.0.1:36217,DS-9e82a5bb-7ece-4d69-a358-a34e816f1f82,DISK], DatanodeInfoWithStorage[127.0.0.1:33679,DS-cea132fd-cef2-489b-9e74-50ae291ed71b,DISK]] 2023-07-19 13:10:35,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:35,435 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-19 13:10:35,437 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:35,438 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-19 13:10:35,440 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-19 13:10:35,442 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-19 13:10:35,456 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-19 13:10:35,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:35,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-19 13:10:35,457 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-19 13:10:35,460 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-19 13:10:35,462 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/info 2023-07-19 13:10:35,462 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/info 2023-07-19 13:10:35,463 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-19 13:10:35,471 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:35,471 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-19 13:10:35,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/rep_barrier 2023-07-19 13:10:35,472 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/rep_barrier 2023-07-19 13:10:35,473 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-19 13:10:35,475 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:35,483 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-19 13:10:35,486 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/table 2023-07-19 13:10:35,486 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/table 2023-07-19 13:10:35,486 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-19 13:10:35,487 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:35,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740 2023-07-19 13:10:35,491 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740 2023-07-19 13:10:35,495 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-19 13:10:35,497 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-19 13:10:35,498 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60173503, jitterRate=-0.10334493219852448}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-19 13:10:35,501 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-19 13:10:35,515 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689772235327 2023-07-19 13:10:35,540 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34931,1689772233028, state=OPEN 2023-07-19 13:10:35,542 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-19 13:10:35,544 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-19 13:10:35,544 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-19 13:10:35,544 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-19 13:10:35,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-19 13:10:35,549 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34931,1689772233028 in 453 msec 2023-07-19 13:10:35,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-19 13:10:35,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 704 msec 2023-07-19 13:10:35,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0940 sec 2023-07-19 13:10:35,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689772235563, completionTime=-1 2023-07-19 13:10:35,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-19 13:10:35,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-19 13:10:35,649 DEBUG [hconnection-0x4082387e-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:35,653 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:35,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-19 13:10:35,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689772295683 2023-07-19 13:10:35,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689772355683 2023-07-19 13:10:35,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 119 msec 2023-07-19 13:10:35,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43411,1689772231278-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43411,1689772231278-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,728 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43411,1689772231278-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43411, period=300000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,735 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-19 13:10:35,746 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-19 13:10:35,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-19 13:10:35,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:35,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-19 13:10:35,776 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:10:35,780 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:10:35,813 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/namespace/01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:35,816 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/namespace/01c1db10903d9b7381868a76322244bc empty. 2023-07-19 13:10:35,817 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/namespace/01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:35,817 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-19 13:10:35,922 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:35,926 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 01c1db10903d9b7381868a76322244bc, NAME => 'hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:10:35,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:35,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 01c1db10903d9b7381868a76322244bc, disabling compactions & flushes 2023-07-19 13:10:35,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:35,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:35,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. after waiting 0 ms 2023-07-19 13:10:35,956 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:35,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:35,957 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 01c1db10903d9b7381868a76322244bc: 2023-07-19 13:10:35,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:10:35,983 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689772235966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772235966"}]},"ts":"1689772235966"} 2023-07-19 13:10:36,022 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 13:10:36,025 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:10:36,033 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772236026"}]},"ts":"1689772236026"} 2023-07-19 13:10:36,037 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-19 13:10:36,043 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:36,045 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:36,045 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:36,045 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:36,045 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:36,048 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=01c1db10903d9b7381868a76322244bc, ASSIGN}] 2023-07-19 13:10:36,052 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=01c1db10903d9b7381868a76322244bc, ASSIGN 2023-07-19 13:10:36,053 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=01c1db10903d9b7381868a76322244bc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1689772233028; forceNewPlan=false, retain=false 2023-07-19 13:10:36,206 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 13:10:36,207 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=01c1db10903d9b7381868a76322244bc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:36,208 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689772236207"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772236207"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772236207"}]},"ts":"1689772236207"} 2023-07-19 13:10:36,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 01c1db10903d9b7381868a76322244bc, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:10:36,380 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:36,380 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01c1db10903d9b7381868a76322244bc, NAME => 'hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:36,381 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. service=AccessControlService 2023-07-19 13:10:36,381 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,382 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,385 INFO [StoreOpener-01c1db10903d9b7381868a76322244bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,387 DEBUG [StoreOpener-01c1db10903d9b7381868a76322244bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/info 2023-07-19 13:10:36,387 DEBUG [StoreOpener-01c1db10903d9b7381868a76322244bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/info 2023-07-19 13:10:36,388 INFO [StoreOpener-01c1db10903d9b7381868a76322244bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01c1db10903d9b7381868a76322244bc columnFamilyName info 2023-07-19 13:10:36,388 INFO [StoreOpener-01c1db10903d9b7381868a76322244bc-1] regionserver.HStore(310): Store=01c1db10903d9b7381868a76322244bc/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:36,390 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,391 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,396 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01c1db10903d9b7381868a76322244bc 2023-07-19 13:10:36,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:36,400 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01c1db10903d9b7381868a76322244bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60730816, jitterRate=-0.09504032135009766}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:36,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01c1db10903d9b7381868a76322244bc: 2023-07-19 13:10:36,403 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc., pid=6, masterSystemTime=1689772236372 2023-07-19 13:10:36,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:36,407 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:10:36,409 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=01c1db10903d9b7381868a76322244bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:36,409 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689772236408"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772236408"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772236408"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772236408"}]},"ts":"1689772236408"} 2023-07-19 13:10:36,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-19 13:10:36,416 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 01c1db10903d9b7381868a76322244bc, server=jenkins-hbase4.apache.org,34931,1689772233028 in 196 msec 2023-07-19 13:10:36,420 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-19 13:10:36,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=01c1db10903d9b7381868a76322244bc, ASSIGN in 368 msec 2023-07-19 13:10:36,422 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:10:36,422 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772236422"}]},"ts":"1689772236422"} 2023-07-19 13:10:36,425 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-19 13:10:36,428 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:10:36,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 669 msec 2023-07-19 13:10:36,475 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-19 13:10:36,476 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-19 13:10:36,477 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:36,511 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-19 13:10:36,532 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 13:10:36,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-07-19 13:10:36,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-19 13:10:36,555 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-19 13:10:36,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 22 msec 2023-07-19 13:10:36,583 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-19 13:10:36,585 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-19 13:10:36,585 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.443sec 2023-07-19 13:10:36,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-19 13:10:36,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-19 13:10:36,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-19 13:10:36,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43411,1689772231278-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-19 13:10:36,593 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43411,1689772231278-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-19 13:10:36,608 DEBUG [Listener at localhost/34677] zookeeper.ReadOnlyZKClient(139): Connect 0x7cbb53b4 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:36,614 DEBUG [Listener at localhost/34677] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79805042, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:36,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:36,632 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-19 13:10:36,635 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:10:36,635 DEBUG [hconnection-0x2aac9ec2-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:36,639 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:10:36,646 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:36,647 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c empty. 2023-07-19 13:10:36,647 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-19 13:10:36,650 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:36,650 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-19 13:10:36,661 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39326, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:36,664 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:10:36,664 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-19 13:10:36,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:36,664 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/test.cache.data in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop.tmp.dir in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop.log.dir in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-19 13:10:36,665 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/nfs.dump.dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-19 13:10:36,666 INFO [Listener at localhost/34677] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-19 13:10:36,705 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:36,708 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5162e4ec2f8caf3a249fd93c09eff31c, NAME => 'hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:10:36,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:36,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5162e4ec2f8caf3a249fd93c09eff31c, disabling compactions & flushes 2023-07-19 13:10:36,742 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:36,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:36,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. after waiting 0 ms 2023-07-19 13:10:36,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:36,742 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:36,742 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5162e4ec2f8caf3a249fd93c09eff31c: 2023-07-19 13:10:36,747 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:10:36,749 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689772236748"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772236748"}]},"ts":"1689772236748"} 2023-07-19 13:10:36,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-19 13:10:36,755 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:10:36,755 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772236755"}]},"ts":"1689772236755"} 2023-07-19 13:10:36,758 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-19 13:10:36,769 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:36,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:36,774 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:36,775 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:36,775 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:36,775 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:36,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5162e4ec2f8caf3a249fd93c09eff31c, ASSIGN}] 2023-07-19 13:10:36,779 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5162e4ec2f8caf3a249fd93c09eff31c, ASSIGN 2023-07-19 13:10:36,781 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5162e4ec2f8caf3a249fd93c09eff31c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1689772233028; forceNewPlan=false, retain=false 2023-07-19 13:10:36,932 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 13:10:36,933 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5162e4ec2f8caf3a249fd93c09eff31c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:36,933 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689772236933"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772236933"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772236933"}]},"ts":"1689772236933"} 2023-07-19 13:10:36,937 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5162e4ec2f8caf3a249fd93c09eff31c, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:10:36,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:37,098 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:37,099 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5162e4ec2f8caf3a249fd93c09eff31c, NAME => 'hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:10:37,099 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. service=AccessControlService 2023-07-19 13:10:37,099 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:37,099 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:37,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,103 INFO [StoreOpener-5162e4ec2f8caf3a249fd93c09eff31c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,106 DEBUG [StoreOpener-5162e4ec2f8caf3a249fd93c09eff31c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/l 2023-07-19 13:10:37,106 DEBUG [StoreOpener-5162e4ec2f8caf3a249fd93c09eff31c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/l 2023-07-19 13:10:37,106 INFO [StoreOpener-5162e4ec2f8caf3a249fd93c09eff31c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5162e4ec2f8caf3a249fd93c09eff31c columnFamilyName l 2023-07-19 13:10:37,108 INFO [StoreOpener-5162e4ec2f8caf3a249fd93c09eff31c-1] regionserver.HStore(310): Store=5162e4ec2f8caf3a249fd93c09eff31c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:37,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,125 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:10:37,144 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:37,145 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5162e4ec2f8caf3a249fd93c09eff31c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73922756, jitterRate=0.101534903049469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:37,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5162e4ec2f8caf3a249fd93c09eff31c: 2023-07-19 13:10:37,147 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c., pid=11, masterSystemTime=1689772237091 2023-07-19 13:10:37,151 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:37,151 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:10:37,152 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5162e4ec2f8caf3a249fd93c09eff31c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:37,152 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689772237152"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772237152"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772237152"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772237152"}]},"ts":"1689772237152"} 2023-07-19 13:10:37,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-19 13:10:37,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5162e4ec2f8caf3a249fd93c09eff31c, server=jenkins-hbase4.apache.org,34931,1689772233028 in 220 msec 2023-07-19 13:10:37,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-19 13:10:37,174 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5162e4ec2f8caf3a249fd93c09eff31c, ASSIGN in 389 msec 2023-07-19 13:10:37,175 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:10:37,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772237176"}]},"ts":"1689772237176"} 2023-07-19 13:10:37,179 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-19 13:10:37,183 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:10:37,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 563 msec 2023-07-19 13:10:37,270 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-19 13:10:37,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-19 13:10:37,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-19 13:10:38,216 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:38,612 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:38,621 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46503_jobhistory____.vymu9/webapp 2023-07-19 13:10:38,831 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-19 13:10:38,832 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:38,832 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:38,837 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:38,941 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:39,300 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:39,649 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-19 13:10:39,691 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46503 2023-07-19 13:10:41,031 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:10:41,241 WARN [Listener at jenkins-hbase4.apache.org/44593] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:41,272 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-19 13:10:41,273 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-19 13:10:41,274 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-19 13:10:41,338 WARN [Listener at jenkins-hbase4.apache.org/44593] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 13:10:41,339 INFO [Listener at jenkins-hbase4.apache.org/44593] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:41,349 INFO [Listener at jenkins-hbase4.apache.org/44593] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41799_cluster____.k6fgk6/webapp 2023-07-19 13:10:41,441 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:41,442 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-19 13:10:41,442 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:41,443 INFO [Listener at jenkins-hbase4.apache.org/44593] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:41,452 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:41,463 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:10:41,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-19 13:10:41,464 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:10:41,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-19 13:10:41,464 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 13:10:41,464 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-19 13:10:41,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:10:41,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-19 13:10:41,465 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 13:10:41,465 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-19 13:10:41,689 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:41,777 INFO [Listener at jenkins-hbase4.apache.org/44593] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:41,785 INFO [Listener at jenkins-hbase4.apache.org/44593] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41799 2023-07-19 13:10:42,332 WARN [Listener at jenkins-hbase4.apache.org/45739] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:42,358 WARN [Listener at jenkins-hbase4.apache.org/45739] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 13:10:42,359 INFO [Listener at jenkins-hbase4.apache.org/45739] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:42,367 INFO [Listener at jenkins-hbase4.apache.org/45739] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_32799_node____.o5gtt6/webapp 2023-07-19 13:10:42,424 INFO [Listener at jenkins-hbase4.apache.org/45739] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 13:10:42,424 INFO [Listener at jenkins-hbase4.apache.org/45739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:42,424 INFO [Listener at jenkins-hbase4.apache.org/45739] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:42,424 INFO [Listener at jenkins-hbase4.apache.org/45739] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:42,436 INFO [Listener at jenkins-hbase4.apache.org/45739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,468 INFO [Listener at jenkins-hbase4.apache.org/45739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,567 INFO [Listener at jenkins-hbase4.apache.org/45739] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,579 INFO [Listener at jenkins-hbase4.apache.org/45739] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:32799 2023-07-19 13:10:42,771 WARN [Listener at jenkins-hbase4.apache.org/34975] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-19 13:10:42,776 WARN [Listener at jenkins-hbase4.apache.org/34975] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-19 13:10:42,777 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): jetty-6.1.26 2023-07-19 13:10:42,784 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39301_node____mw97yk/webapp 2023-07-19 13:10:42,837 INFO [Listener at jenkins-hbase4.apache.org/34975] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-19 13:10:42,837 INFO [Listener at jenkins-hbase4.apache.org/34975] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-19 13:10:42,838 INFO [Listener at jenkins-hbase4.apache.org/34975] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-19 13:10:42,838 INFO [Listener at jenkins-hbase4.apache.org/34975] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-19 13:10:42,847 INFO [Listener at jenkins-hbase4.apache.org/34975] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,865 INFO [Listener at jenkins-hbase4.apache.org/34975] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,964 INFO [Listener at jenkins-hbase4.apache.org/34975] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-19 13:10:42,976 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39301 2023-07-19 13:10:43,024 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-19 13:10:43,026 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:43,119 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=910, MaxFileDescriptor=60000, SystemLoadAverage=319, ProcessCount=177, AvailableMemoryMB=4919 2023-07-19 13:10:43,119 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-07-19 13:10:43,135 DEBUG [Listener at jenkins-hbase4.apache.org/34975] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-19 13:10:43,141 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-19 13:10:43,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:10:43,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:10:43,165 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:10:43,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-19 13:10:43,167 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:10:43,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:43,172 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,172 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,179 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d empty. 2023-07-19 13:10:43,180 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa empty. 2023-07-19 13:10:43,182 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,183 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,183 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 13:10:43,236 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-19 13:10:43,241 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => c2921098689939e5d079c061252e06aa, NAME => 'testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:10:43,241 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => a1d7d3c874efaeeeaf4467c91e70e00d, NAME => 'testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:10:43,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:43,292 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:43,293 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing a1d7d3c874efaeeeaf4467c91e70e00d, disabling compactions & flushes 2023-07-19 13:10:43,293 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,293 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,293 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. after waiting 0 ms 2023-07-19 13:10:43,293 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,293 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,293 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for a1d7d3c874efaeeeaf4467c91e70e00d: 2023-07-19 13:10:43,307 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:43,307 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing c2921098689939e5d079c061252e06aa, disabling compactions & flushes 2023-07-19 13:10:43,307 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,307 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,307 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. after waiting 0 ms 2023-07-19 13:10:43,307 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,307 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,308 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for c2921098689939e5d079c061252e06aa: 2023-07-19 13:10:43,313 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:10:43,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772243314"}]},"ts":"1689772243314"} 2023-07-19 13:10:43,315 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243314"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772243314"}]},"ts":"1689772243314"} 2023-07-19 13:10:43,377 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:10:43,379 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:10:43,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772243379"}]},"ts":"1689772243379"} 2023-07-19 13:10:43,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-19 13:10:43,386 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:10:43,389 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:10:43,389 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:10:43,389 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:10:43,389 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:10:43,389 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, ASSIGN}] 2023-07-19 13:10:43,394 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, ASSIGN 2023-07-19 13:10:43,394 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, ASSIGN 2023-07-19 13:10:43,396 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39417,1689772232852; forceNewPlan=false, retain=false 2023-07-19 13:10:43,396 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33135,1689772232949; forceNewPlan=false, retain=false 2023-07-19 13:10:43,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:43,546 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:10:43,549 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c2921098689939e5d079c061252e06aa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:43,549 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a1d7d3c874efaeeeaf4467c91e70e00d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:43,549 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772243549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772243549"}]},"ts":"1689772243549"} 2023-07-19 13:10:43,549 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243549"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772243549"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772243549"}]},"ts":"1689772243549"} 2023-07-19 13:10:43,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure a1d7d3c874efaeeeaf4467c91e70e00d, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:10:43,554 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure c2921098689939e5d079c061252e06aa, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:10:43,708 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:43,709 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:43,709 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:10:43,709 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:10:43,713 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54044, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:10:43,716 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:10:43,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a1d7d3c874efaeeeaf4467c91e70e00d, NAME => 'testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:10:43,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. service=AccessControlService 2023-07-19 13:10:43,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2921098689939e5d079c061252e06aa, NAME => 'testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:10:43,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. service=AccessControlService 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,730 INFO [StoreOpener-c2921098689939e5d079c061252e06aa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,742 DEBUG [StoreOpener-c2921098689939e5d079c061252e06aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf 2023-07-19 13:10:43,743 DEBUG [StoreOpener-c2921098689939e5d079c061252e06aa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf 2023-07-19 13:10:43,743 INFO [StoreOpener-c2921098689939e5d079c061252e06aa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2921098689939e5d079c061252e06aa columnFamilyName cf 2023-07-19 13:10:43,745 INFO [StoreOpener-c2921098689939e5d079c061252e06aa-1] regionserver.HStore(310): Store=c2921098689939e5d079c061252e06aa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:43,745 INFO [StoreOpener-a1d7d3c874efaeeeaf4467c91e70e00d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,751 DEBUG [StoreOpener-a1d7d3c874efaeeeaf4467c91e70e00d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf 2023-07-19 13:10:43,751 DEBUG [StoreOpener-a1d7d3c874efaeeeaf4467c91e70e00d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf 2023-07-19 13:10:43,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,751 INFO [StoreOpener-a1d7d3c874efaeeeaf4467c91e70e00d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a1d7d3c874efaeeeaf4467c91e70e00d columnFamilyName cf 2023-07-19 13:10:43,754 INFO [StoreOpener-a1d7d3c874efaeeeaf4467c91e70e00d-1] regionserver.HStore(310): Store=a1d7d3c874efaeeeaf4467c91e70e00d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:10:43,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2921098689939e5d079c061252e06aa 2023-07-19 13:10:43,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,776 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:10:43,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:43,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:10:43,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:43,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2921098689939e5d079c061252e06aa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74706083, jitterRate=0.1132073849439621}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:43,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2921098689939e5d079c061252e06aa: 2023-07-19 13:10:43,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a1d7d3c874efaeeeaf4467c91e70e00d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60596340, jitterRate=-0.09704416990280151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:10:43,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a1d7d3c874efaeeeaf4467c91e70e00d: 2023-07-19 13:10:43,795 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa., pid=16, masterSystemTime=1689772243708 2023-07-19 13:10:43,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d., pid=15, masterSystemTime=1689772243708 2023-07-19 13:10:43,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:43,806 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c2921098689939e5d079c061252e06aa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:43,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:43,807 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243806"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772243806"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772243806"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772243806"}]},"ts":"1689772243806"} 2023-07-19 13:10:43,808 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=a1d7d3c874efaeeeaf4467c91e70e00d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:43,808 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772243808"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772243808"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772243808"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772243808"}]},"ts":"1689772243808"} 2023-07-19 13:10:43,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-19 13:10:43,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure c2921098689939e5d079c061252e06aa, server=jenkins-hbase4.apache.org,33135,1689772232949 in 256 msec 2023-07-19 13:10:43,819 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-19 13:10:43,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure a1d7d3c874efaeeeaf4467c91e70e00d, server=jenkins-hbase4.apache.org,39417,1689772232852 in 260 msec 2023-07-19 13:10:43,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, ASSIGN in 426 msec 2023-07-19 13:10:43,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-19 13:10:43,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, ASSIGN in 430 msec 2023-07-19 13:10:43,824 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:10:43,825 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772243824"}]},"ts":"1689772243824"} 2023-07-19 13:10:43,827 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-19 13:10:43,830 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:10:43,836 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-19 13:10:43,856 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 13:10:43,887 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:43,887 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:43,887 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:43,887 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-19 13:10:43,888 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:10:43,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:43,899 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:43,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:43,900 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-19 13:10:43,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 750 msec 2023-07-19 13:10:44,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-19 13:10:44,293 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-19 13:10:44,293 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-19 13:10:44,294 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:44,299 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-19 13:10:44,300 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:44,300 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-19 13:10:44,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772244318 (current time:1689772244318). 2023-07-19 13:10:44,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:10:44,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x57d0a282 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:44,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2925a3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:44,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,329 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57d0a282 to 127.0.0.1:64397 2023-07-19 13:10:44,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:44,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x1996f1f0 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:44,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29d4201, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:44,347 DEBUG [hconnection-0x432ee424-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,351 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1996f1f0 to 127.0.0.1:64397 2023-07-19 13:10:44,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:44,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 13:10:44,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:10:44,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,412 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,414 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689772844414 2023-07-19 13:10:44,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,414 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 13:10:44,417 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,420 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 14 msec 2023-07-19 13:10:44,421 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,422 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689772844422 2023-07-19 13:10:44,423 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:10:44,423 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:10:44,454 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,455 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-19 13:10:44,455 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,456 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 13:10:44,456 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 13:10:44,457 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,457 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,465 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,465 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,465 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,465 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,466 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,466 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,467 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,467 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:10:44,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,468 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,471 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,473 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:44,471 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,473 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:44,473 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,473 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:44,473 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,474 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:44,475 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:44,475 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:44,475 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:44,475 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:44,475 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,477 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,477 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,478 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,478 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:44,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@691658c7[Count = 1] remaining members to acquire global barrier 2023-07-19 13:10:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:44,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@691658c7[Count = 0] remaining members to acquire global barrier 2023-07-19 13:10:44,484 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 13:10:44,484 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,486 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:44,486 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:44,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,487 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:44,487 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:44,487 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:10:44,487 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,487 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:10:44,488 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:44,488 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:44,488 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:44,488 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. started... 2023-07-19 13:10:44,491 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:44,491 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:44,491 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:44,491 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. started... 2023-07-19 13:10:44,491 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:44,492 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:44,493 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1d7d3c874efaeeeaf4467c91e70e00d: 2023-07-19 13:10:44,493 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2921098689939e5d079c061252e06aa: 2023-07-19 13:10:44,495 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,495 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,500 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:44,500 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:44,504 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:10:44,504 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:10:44,523 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:44,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:44,531 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. completed. 2023-07-19 13:10:44,531 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:44,531 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. completed. 2023-07-19 13:10:44,531 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:10:44,532 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:10:44,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:44,534 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:10:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:44,534 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,534 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:44,536 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,536 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:44,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 13:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:10:44,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 13:10:44,548 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-19 13:10:44,548 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:10:44,548 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:10:44,548 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,548 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:44,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,551 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:44,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:44,552 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:44,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,553 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,554 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,556 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,556 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,557 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:44,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,569 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:44,569 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:44,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,570 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:44,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,569 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:44,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:44,570 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,571 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,571 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,571 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:44,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:44,571 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,571 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,571 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 13:10:44,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,685 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-19 13:10:44,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689772244414Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689772244570 (+156 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689772244571 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689772244583 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689772244601 (+18 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689772244685 (+84 ms) 2023-07-19 13:10:44,687 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 271 msec 2023-07-19 13:10:44,734 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:44,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:44,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:10:44,757 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,757 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,764 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54056, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,765 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:10:44,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33135] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:10:44,773 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-19 13:10:44,774 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:44,777 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:10:44,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772244812 (current time:1689772244812). 2023-07-19 13:10:44,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:10:44,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x6e9f4d2e to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:44,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5ca725cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:44,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,835 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e9f4d2e to 127.0.0.1:64397 2023-07-19 13:10:44,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:44,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x46f248de to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:10:44,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52909b13, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:10:44,846 DEBUG [hconnection-0x377c55c1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:10:44,847 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:10:44,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f248de to 127.0.0.1:64397 2023-07-19 13:10:44,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:10:44,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-19 13:10:44,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:10:44,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,861 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,864 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689772844864 2023-07-19 13:10:44,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-19 13:10:44,865 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-19 13:10:44,866 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:10:44,866 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:10:44,868 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-19 13:10:44,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,871 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-19 13:10:44,873 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:44,874 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689772844874 2023-07-19 13:10:44,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-19 13:10:44,913 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-19 13:10:44,913 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,914 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-19 13:10:44,914 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-19 13:10:44,915 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,915 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,917 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,917 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,917 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,917 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:44,918 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,919 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,920 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-19 13:10:44,920 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,920 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,921 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,921 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:10:44,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 13:10:44,926 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 13:10:44,926 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,926 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-19 13:10:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-19 13:10:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:44,928 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:10:44,929 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:44,930 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-19 13:10:44,930 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-19 13:10:44,930 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:44,930 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-19 13:10:44,932 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,933 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,933 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:44,933 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,934 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:10:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:44,936 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de5b3f0[Count = 1] remaining members to acquire global barrier 2023-07-19 13:10:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:44,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:44,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:44,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:44,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:44,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:44,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-19 13:10:44,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@de5b3f0[Count = 0] remaining members to acquire global barrier 2023-07-19 13:10:44,943 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-19 13:10:44,943 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:44,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:44,949 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-19 13:10:44,950 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:44,950 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. started... 2023-07-19 13:10:44,950 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:44,950 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. started... 2023-07-19 13:10:44,950 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:10:44,950 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a1d7d3c874efaeeeaf4467c91e70e00d 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 13:10:44,950 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2921098689939e5d079c061252e06aa 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 13:10:44,952 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:44,952 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:10:44,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:44,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:44,955 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:44,966 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:44,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:44,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:44,968 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:10:45,058 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/.tmp/cf/0ca15687bd29470a80a83dbf052dc6e1 2023-07-19 13:10:45,064 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/.tmp/cf/529ad7111e02499591454bd1e4a2ca90 2023-07-19 13:10:45,114 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/.tmp/cf/529ad7111e02499591454bd1e4a2ca90 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf/529ad7111e02499591454bd1e4a2ca90 2023-07-19 13:10:45,114 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/.tmp/cf/0ca15687bd29470a80a83dbf052dc6e1 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf/0ca15687bd29470a80a83dbf052dc6e1 2023-07-19 13:10:45,125 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf/529ad7111e02499591454bd1e4a2ca90, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 13:10:45,129 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a1d7d3c874efaeeeaf4467c91e70e00d in 179ms, sequenceid=6, compaction requested=false 2023-07-19 13:10:45,129 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-19 13:10:45,130 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf/0ca15687bd29470a80a83dbf052dc6e1, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 13:10:45,133 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a1d7d3c874efaeeeaf4467c91e70e00d: 2023-07-19 13:10:45,133 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:45,133 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:45,134 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c2921098689939e5d079c061252e06aa in 183ms, sequenceid=6, compaction requested=false 2023-07-19 13:10:45,134 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf/529ad7111e02499591454bd1e4a2ca90] hfiles 2023-07-19 13:10:45,135 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2921098689939e5d079c061252e06aa: 2023-07-19 13:10:45,135 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf/529ad7111e02499591454bd1e4a2ca90 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:45,135 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:45,135 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:10:45,135 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf/0ca15687bd29470a80a83dbf052dc6e1] hfiles 2023-07-19 13:10:45,135 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf/0ca15687bd29470a80a83dbf052dc6e1 for snapshot=snaptb0-testExportWithTargetName 2023-07-19 13:10:45,169 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:45,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:45,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:10:45,177 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:10:45,177 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. completed. 2023-07-19 13:10:45,177 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:10:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:10:45,180 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,180 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,180 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,180 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,187 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. completed. 2023-07-19 13:10:45,187 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:10:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:10:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:10:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-19 13:10:45,188 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:10:45,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,192 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-19 13:10:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,192 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-19 13:10:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:10:45,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-19 13:10:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:10:45,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-19 13:10:45,201 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-19 13:10:45,201 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:10:45,201 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:10:45,201 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-19 13:10:45,201 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,204 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,205 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:10:45,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,206 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,206 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,208 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,208 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,209 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:10:45,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-19 13:10:45,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:45,226 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:10:45,227 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:10:45,226 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-19 13:10:45,228 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:10:45,226 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-19 13:10:45,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:45,228 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:10:45,228 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:10:45,228 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:10:45,228 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:10:45,228 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,229 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:10:45,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:10:45,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,314 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-19 13:10:45,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,314 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-19 13:10:45,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689772244865Consolidate snapshot: snaptb0-testExportWithTargetName at 1689772245228 (+363 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689772245228Writing data manifest for snaptb0-testExportWithTargetName at 1689772245234 (+6 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689772245262 (+28 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689772245314 (+52 ms) 2023-07-19 13:10:45,316 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-19 13:10:45,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 450 msec 2023-07-19 13:10:45,477 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:10:45,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-19 13:10:45,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:10:45,480 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480 2023-07-19 13:10:45,481 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42099, tgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480, rawTgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:10:45,523 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:10:45,523 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_953946446_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 13:10:45,523 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-19 13:10:45,540 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-19 13:10:45,625 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:45,626 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:45,626 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:45,627 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,638 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-1318900323119444978.jar 2023-07-19 13:10:46,639 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,639 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,709 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-4011643303126192710.jar 2023-07-19 13:10:46,710 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,711 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,711 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,712 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,712 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,713 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:10:46,713 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:10:46,714 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:10:46,714 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:10:46,715 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:10:46,716 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:10:46,717 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:10:46,717 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:10:46,718 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:10:46,718 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:10:46,719 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:10:46,723 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:46,724 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:46,724 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:10:46,724 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:46,725 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:10:46,725 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:10:46,726 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:10:48,135 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:10:48,142 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-19 13:10:48,153 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 13:10:48,701 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:10:48,702 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:10:48,907 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0001_000001 (auth:SIMPLE) 2023-07-19 13:10:49,244 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:10:54,291 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0001_000001 (auth:SIMPLE) 2023-07-19 13:10:56,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0001_000001 (auth:SIMPLE) 2023-07-19 13:10:59,296 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0001_000001 (auth:SIMPLE) 2023-07-19 13:11:01,107 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:01,110 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:01,121 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-19 13:11:01,121 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:01,122 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:01,122 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-19 13:11:01,123 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-19 13:11:01,123 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-19 13:11:01,123 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480/.hbase-snapshot/testExportWithTargetName 2023-07-19 13:11:01,124 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-19 13:11:01,124 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772245480/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-19 13:11:01,137 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-19 13:11:01,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-19 13:11:01,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772261161"}]},"ts":"1689772261161"} 2023-07-19 13:11:01,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 13:11:01,163 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-19 13:11:01,165 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-19 13:11:01,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, UNASSIGN}] 2023-07-19 13:11:01,170 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, UNASSIGN 2023-07-19 13:11:01,170 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, UNASSIGN 2023-07-19 13:11:01,171 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c2921098689939e5d079c061252e06aa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:01,171 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a1d7d3c874efaeeeaf4467c91e70e00d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:01,171 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772261171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772261171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772261171"}]},"ts":"1689772261171"} 2023-07-19 13:11:01,171 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772261171"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772261171"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772261171"}]},"ts":"1689772261171"} 2023-07-19 13:11:01,175 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure c2921098689939e5d079c061252e06aa, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:11:01,179 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure a1d7d3c874efaeeeaf4467c91e70e00d, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:11:01,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 13:11:01,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a1d7d3c874efaeeeaf4467c91e70e00d, disabling compactions & flushes 2023-07-19 13:11:01,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2921098689939e5d079c061252e06aa 2023-07-19 13:11:01,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. after waiting 0 ms 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2921098689939e5d079c061252e06aa, disabling compactions & flushes 2023-07-19 13:11:01,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:11:01,336 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. after waiting 0 ms 2023-07-19 13:11:01,337 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:11:01,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:01,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:01,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:01,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:01,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa. 2023-07-19 13:11:01,358 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d. 2023-07-19 13:11:01,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2921098689939e5d079c061252e06aa: 2023-07-19 13:11:01,359 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a1d7d3c874efaeeeaf4467c91e70e00d: 2023-07-19 13:11:01,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2921098689939e5d079c061252e06aa 2023-07-19 13:11:01,362 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c2921098689939e5d079c061252e06aa, regionState=CLOSED 2023-07-19 13:11:01,363 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772261362"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772261362"}]},"ts":"1689772261362"} 2023-07-19 13:11:01,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:11:01,363 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=a1d7d3c874efaeeeaf4467c91e70e00d, regionState=CLOSED 2023-07-19 13:11:01,364 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689772261363"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772261363"}]},"ts":"1689772261363"} 2023-07-19 13:11:01,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-19 13:11:01,369 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure c2921098689939e5d079c061252e06aa, server=jenkins-hbase4.apache.org,33135,1689772232949 in 190 msec 2023-07-19 13:11:01,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-19 13:11:01,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure a1d7d3c874efaeeeaf4467c91e70e00d, server=jenkins-hbase4.apache.org,39417,1689772232852 in 187 msec 2023-07-19 13:11:01,371 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c2921098689939e5d079c061252e06aa, UNASSIGN in 202 msec 2023-07-19 13:11:01,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-19 13:11:01,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=a1d7d3c874efaeeeaf4467c91e70e00d, UNASSIGN in 203 msec 2023-07-19 13:11:01,374 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772261374"}]},"ts":"1689772261374"} 2023-07-19 13:11:01,379 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-19 13:11:01,381 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-19 13:11:01,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 235 msec 2023-07-19 13:11:01,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-19 13:11:01,465 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-19 13:11:01,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-19 13:11:01,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,481 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-19 13:11:01,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,487 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-19 13:11:01,490 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:01,490 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:01,491 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:11:01,491 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:01,491 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa 2023-07-19 13:11:01,491 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-19 13:11:01,496 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:01,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 13:11:01,496 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:01,496 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:01,496 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:01,496 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:01,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 13:11:01,496 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:01,496 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 13:11:01,496 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:01,498 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-19 13:11:01,498 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:01,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 13:11:01,502 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/recovered.edits] 2023-07-19 13:11:01,502 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/recovered.edits] 2023-07-19 13:11:01,511 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf/529ad7111e02499591454bd1e4a2ca90 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/cf/529ad7111e02499591454bd1e4a2ca90 2023-07-19 13:11:01,511 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf/0ca15687bd29470a80a83dbf052dc6e1 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/cf/0ca15687bd29470a80a83dbf052dc6e1 2023-07-19 13:11:01,519 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d/recovered.edits/9.seqid 2023-07-19 13:11:01,519 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa/recovered.edits/9.seqid 2023-07-19 13:11:01,520 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/a1d7d3c874efaeeeaf4467c91e70e00d 2023-07-19 13:11:01,520 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportWithTargetName/c2921098689939e5d079c061252e06aa 2023-07-19 13:11:01,520 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-19 13:11:01,524 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,549 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-19 13:11:01,552 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-19 13:11:01,555 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,555 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-19 13:11:01,555 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772261555"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:01,555 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772261555"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:01,558 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:11:01,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a1d7d3c874efaeeeaf4467c91e70e00d, NAME => 'testtb-testExportWithTargetName,,1689772243149.a1d7d3c874efaeeeaf4467c91e70e00d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c2921098689939e5d079c061252e06aa, NAME => 'testtb-testExportWithTargetName,1,1689772243149.c2921098689939e5d079c061252e06aa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:11:01,558 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-19 13:11:01,558 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772261558"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:01,560 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-19 13:11:01,562 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-19 13:11:01,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 90 msec 2023-07-19 13:11:01,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-19 13:11:01,601 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-19 13:11:01,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-19 13:11:01,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-19 13:11:01,632 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-19 13:11:01,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-19 13:11:01,673 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 705) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1354773013_1 at /127.0.0.1:58226 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1354773013_1 at /127.0.0.1:50162 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:51370 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:41702 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:37923 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:44362 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:42469 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1282 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 910) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=360 (was 319) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=3107 (was 4919) 2023-07-19 13:11:01,674 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-19 13:11:01,702 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=360, ProcessCount=183, AvailableMemoryMB=3108 2023-07-19 13:11:01,702 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-19 13:11:01,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:11:01,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:01,711 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:01,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-19 13:11:01,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:01,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:01,716 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:01,717 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf empty. 2023-07-19 13:11:01,717 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:01,718 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:01,718 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa empty. 2023-07-19 13:11:01,718 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:01,718 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 13:11:01,746 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:01,747 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9c32fc894bb41ab4835b1b5edbacb8cf, NAME => 'testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:01,748 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => a717c47d65a1733e78a1f808226d87fa, NAME => 'testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:01,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 9c32fc894bb41ab4835b1b5edbacb8cf, disabling compactions & flushes 2023-07-19 13:11:01,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:01,784 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing a717c47d65a1733e78a1f808226d87fa, disabling compactions & flushes 2023-07-19 13:11:01,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. after waiting 0 ms 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:01,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for a717c47d65a1733e78a1f808226d87fa: 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. after waiting 0 ms 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:01,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:01,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 9c32fc894bb41ab4835b1b5edbacb8cf: 2023-07-19 13:11:01,789 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:01,790 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772261790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772261790"}]},"ts":"1689772261790"} 2023-07-19 13:11:01,790 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772261790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772261790"}]},"ts":"1689772261790"} 2023-07-19 13:11:01,793 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:01,794 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:01,794 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772261794"}]},"ts":"1689772261794"} 2023-07-19 13:11:01,796 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 13:11:01,805 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:01,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:01,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:01,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:01,806 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:01,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, ASSIGN}] 2023-07-19 13:11:01,810 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, ASSIGN 2023-07-19 13:11:01,810 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, ASSIGN 2023-07-19 13:11:01,811 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39417,1689772232852; forceNewPlan=false, retain=false 2023-07-19 13:11:01,811 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1689772233028; forceNewPlan=false, retain=false 2023-07-19 13:11:01,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:01,961 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:01,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9c32fc894bb41ab4835b1b5edbacb8cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:01,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a717c47d65a1733e78a1f808226d87fa, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:01,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772261963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772261963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772261963"}]},"ts":"1689772261963"} 2023-07-19 13:11:01,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772261963"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772261963"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772261963"}]},"ts":"1689772261963"} 2023-07-19 13:11:01,966 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 9c32fc894bb41ab4835b1b5edbacb8cf, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:11:01,967 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure a717c47d65a1733e78a1f808226d87fa, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:11:02,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:02,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9c32fc894bb41ab4835b1b5edbacb8cf, NAME => 'testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:11:02,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. service=AccessControlService 2023-07-19 13:11:02,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:02,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:02,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a717c47d65a1733e78a1f808226d87fa, NAME => 'testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:11:02,130 INFO [StoreOpener-9c32fc894bb41ab4835b1b5edbacb8cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. service=AccessControlService 2023-07-19 13:11:02,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:02,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:02,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,132 DEBUG [StoreOpener-9c32fc894bb41ab4835b1b5edbacb8cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf 2023-07-19 13:11:02,132 DEBUG [StoreOpener-9c32fc894bb41ab4835b1b5edbacb8cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf 2023-07-19 13:11:02,132 INFO [StoreOpener-a717c47d65a1733e78a1f808226d87fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,133 INFO [StoreOpener-9c32fc894bb41ab4835b1b5edbacb8cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9c32fc894bb41ab4835b1b5edbacb8cf columnFamilyName cf 2023-07-19 13:11:02,133 INFO [StoreOpener-9c32fc894bb41ab4835b1b5edbacb8cf-1] regionserver.HStore(310): Store=9c32fc894bb41ab4835b1b5edbacb8cf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:02,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,136 DEBUG [StoreOpener-a717c47d65a1733e78a1f808226d87fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf 2023-07-19 13:11:02,136 DEBUG [StoreOpener-a717c47d65a1733e78a1f808226d87fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf 2023-07-19 13:11:02,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,137 INFO [StoreOpener-a717c47d65a1733e78a1f808226d87fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a717c47d65a1733e78a1f808226d87fa columnFamilyName cf 2023-07-19 13:11:02,138 INFO [StoreOpener-a717c47d65a1733e78a1f808226d87fa-1] regionserver.HStore(310): Store=a717c47d65a1733e78a1f808226d87fa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:02,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:02,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:02,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:02,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9c32fc894bb41ab4835b1b5edbacb8cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60493417, jitterRate=-0.0985778421163559}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:02,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9c32fc894bb41ab4835b1b5edbacb8cf: 2023-07-19 13:11:02,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf., pid=30, masterSystemTime=1689772262118 2023-07-19 13:11:02,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:02,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a717c47d65a1733e78a1f808226d87fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64129733, jitterRate=-0.04439251124858856}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:02,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a717c47d65a1733e78a1f808226d87fa: 2023-07-19 13:11:02,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,149 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=9c32fc894bb41ab4835b1b5edbacb8cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa., pid=31, masterSystemTime=1689772262119 2023-07-19 13:11:02,149 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772262149"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772262149"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772262149"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772262149"}]},"ts":"1689772262149"} 2023-07-19 13:11:02,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,153 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=a717c47d65a1733e78a1f808226d87fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,155 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772262153"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772262153"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772262153"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772262153"}]},"ts":"1689772262153"} 2023-07-19 13:11:02,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-19 13:11:02,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 9c32fc894bb41ab4835b1b5edbacb8cf, server=jenkins-hbase4.apache.org,39417,1689772232852 in 186 msec 2023-07-19 13:11:02,158 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, ASSIGN in 349 msec 2023-07-19 13:11:02,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-19 13:11:02,161 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure a717c47d65a1733e78a1f808226d87fa, server=jenkins-hbase4.apache.org,34931,1689772233028 in 190 msec 2023-07-19 13:11:02,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-19 13:11:02,164 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, ASSIGN in 354 msec 2023-07-19 13:11:02,165 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:02,165 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772262165"}]},"ts":"1689772262165"} 2023-07-19 13:11:02,167 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 13:11:02,169 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:02,170 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-19 13:11:02,172 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:11:02,173 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:02,173 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:02,173 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:02,173 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:02,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:02,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:02,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:02,175 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:02,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 469 msec 2023-07-19 13:11:02,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-19 13:11:02,317 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-19 13:11:02,317 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 13:11:02,317 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:02,320 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 13:11:02,321 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:02,321 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-19 13:11:02,324 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:02,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772262324 (current time:1689772262324). 2023-07-19 13:11:02,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:02,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x1321c27f to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:02,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b8eae79, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:02,336 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:02,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1321c27f to 127.0.0.1:64397 2023-07-19 13:11:02,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:02,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x3466d9ff to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:02,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2949c736, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:02,347 DEBUG [hconnection-0x574a4900-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:02,350 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51838, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3466d9ff to 127.0.0.1:64397 2023-07-19 13:11:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:11:02,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:02,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:02,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:02,359 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:02,360 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772862360 2023-07-19 13:11:02,360 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 13:11:02,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:02,361 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:02,362 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:02,363 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:02,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:02,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-19 13:11:02,365 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:02,366 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772862366 2023-07-19 13:11:02,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,380 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-19 13:11:02,381 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,382 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 13:11:02,382 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:11:02,383 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,383 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,385 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,385 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,385 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,385 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,386 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,386 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,386 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,386 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:02,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:02,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,387 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:02,389 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,389 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:02,389 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:02,389 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:02,389 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,390 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:02,390 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:02,390 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-19 13:11:02,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,391 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:02,392 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:02,392 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:02,393 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:02,396 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,396 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,396 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,397 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,397 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,397 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:02,398 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,398 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,398 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:02,398 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,398 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:02,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:02,400 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13367d2d[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:02,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13367d2d[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:02,403 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:11:02,403 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,405 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,405 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,405 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:02,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,406 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:02,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,406 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:02,406 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. started... 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:02,406 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,406 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:02,406 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:02,408 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:02,408 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c32fc894bb41ab4835b1b5edbacb8cf: 2023-07-19 13:11:02,408 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,408 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. started... 2023-07-19 13:11:02,408 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,409 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a717c47d65a1733e78a1f808226d87fa: 2023-07-19 13:11:02,409 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:02,409 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:02,409 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,409 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:02,409 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:02,410 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:02,410 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,410 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:02,423 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. completed. 2023-07-19 13:11:02,423 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:02,423 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:02,424 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:02,425 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,425 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,425 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,431 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. completed. 2023-07-19 13:11:02,431 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:02,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:02,431 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:02,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34931,1689772233028': 2023-07-19 13:11:02,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:11:02,432 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:02,432 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,433 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,433 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:11:02,438 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:11:02,438 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-19 13:11:02,438 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:02,438 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:02,438 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,438 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:02,444 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,444 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,444 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,444 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,444 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,444 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,445 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,446 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,446 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,447 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,449 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,449 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,449 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,453 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,453 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,453 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,453 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,453 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,453 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,455 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,455 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,455 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,455 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,455 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,462 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:02,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:02,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:02,463 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:02,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 13:11:02,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,507 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:02,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689772262360Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689772262453 (+93 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689772262453Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689772262459 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689772262472 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689772262506 (+34 ms) 2023-07-19 13:11:02,510 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:02,512 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 149 msec 2023-07-19 13:11:02,663 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:02,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:02,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:02,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:02,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34931] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:02,681 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-19 13:11:02,681 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,681 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:02,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:02,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772262694 (current time:1689772262694). 2023-07-19 13:11:02,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:02,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x7c510641 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:02,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@361e913e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:02,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:02,703 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:02,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7c510641 to 127.0.0.1:64397 2023-07-19 13:11:02,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:02,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x69f2ece7 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:02,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fb07975, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:02,715 DEBUG [hconnection-0xe715f66-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:02,718 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51848, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:02,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69f2ece7 to 127.0.0.1:64397 2023-07-19 13:11:02,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:02,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:11:02,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:02,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:02,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:02,727 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:02,728 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772862728 2023-07-19 13:11:02,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-19 13:11:02,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:11:02,729 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:02,729 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:02,730 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:02,730 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:11:02,732 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-19 13:11:02,732 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:02,733 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772862733 2023-07-19 13:11:02,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-19 13:11:02,745 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-19 13:11:02,745 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,747 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-19 13:11:02,747 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:11:02,747 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,747 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,749 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,749 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,749 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,749 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,749 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,749 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,750 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,750 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-19 13:11:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,751 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 13:11:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:02,751 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,753 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:02,753 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-19 13:11:02,754 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:02,754 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:02,753 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:02,754 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:02,754 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-19 13:11:02,754 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:02,754 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:02,755 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-19 13:11:02,755 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-19 13:11:02,755 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-19 13:11:02,757 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,757 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,757 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:02,762 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,762 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,763 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,763 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50eef604[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-19 13:11:02,768 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50eef604[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:02,768 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:11:02,768 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:02,770 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:02,770 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,771 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:02,770 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:02,771 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:02,770 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,770 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,771 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. started... 2023-07-19 13:11:02,771 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. started... 2023-07-19 13:11:02,771 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9c32fc894bb41ab4835b1b5edbacb8cf 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 13:11:02,771 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a717c47d65a1733e78a1f808226d87fa 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 13:11:02,772 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:02,772 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,772 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:02,793 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/.tmp/cf/947a85c585224d9ea14a670344cac72a 2023-07-19 13:11:02,794 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/.tmp/cf/12d1ec53a58b48e79c175d7fb2a10edb 2023-07-19 13:11:02,802 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/.tmp/cf/947a85c585224d9ea14a670344cac72a as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf/947a85c585224d9ea14a670344cac72a 2023-07-19 13:11:02,802 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/.tmp/cf/12d1ec53a58b48e79c175d7fb2a10edb as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf/12d1ec53a58b48e79c175d7fb2a10edb 2023-07-19 13:11:02,808 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf/947a85c585224d9ea14a670344cac72a, entries=2, sequenceid=6, filesize=5.0 K 2023-07-19 13:11:02,811 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf/12d1ec53a58b48e79c175d7fb2a10edb, entries=48, sequenceid=6, filesize=8.1 K 2023-07-19 13:11:02,812 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 9c32fc894bb41ab4835b1b5edbacb8cf in 41ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:02,812 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 13:11:02,813 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for a717c47d65a1733e78a1f808226d87fa in 41ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:02,813 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9c32fc894bb41ab4835b1b5edbacb8cf: 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a717c47d65a1733e78a1f808226d87fa: 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf/947a85c585224d9ea14a670344cac72a] hfiles 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf/12d1ec53a58b48e79c175d7fb2a10edb] hfiles 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf/12d1ec53a58b48e79c175d7fb2a10edb for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:02,815 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf/947a85c585224d9ea14a670344cac72a for snapshot=snaptb0-testExportFileSystemState 2023-07-19 13:11:02,829 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:02,833 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. completed. 2023-07-19 13:11:02,833 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. completed. 2023-07-19 13:11:02,833 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:02,833 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:02,833 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:02,833 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:02,833 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:02,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:02,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-19 13:11:02,834 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:02,834 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,839 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:02,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,839 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-19 13:11:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,840 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,840 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-19 13:11:02,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34931,1689772233028': 2023-07-19 13:11:02,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:11:02,853 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-19 13:11:02,853 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:02,853 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:02,853 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-19 13:11:02,853 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,856 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:02,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,856 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:02,856 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,858 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,859 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,859 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:02,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-19 13:11:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,863 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,863 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:02,863 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,863 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:02,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,863 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,863 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:02,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-19 13:11:02,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-19 13:11:02,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:02,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,863 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,865 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:02,865 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,865 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:02,865 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:02,865 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,866 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:02,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:02,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,913 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-19 13:11:02,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,914 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:02,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689772262728Consolidate snapshot: snaptb0-testExportFileSystemState at 1689772262865 (+137 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689772262865Writing data manifest for snaptb0-testExportFileSystemState at 1689772262869 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689772262883 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689772262913 (+30 ms) 2023-07-19 13:11:02,916 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-19 13:11:02,918 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 187 msec 2023-07-19 13:11:03,034 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:03,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:11:03,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:03,040 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040 2023-07-19 13:11:03,040 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42099, tgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040, rawTgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:03,071 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:03,071 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1485156660_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:03,071 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-19 13:11:03,098 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-19 13:11:03,132 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:03,133 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:03,133 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:03,134 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,097 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-1309965083256462987.jar 2023-07-19 13:11:04,097 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,098 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,167 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-412188856806166924.jar 2023-07-19 13:11:04,167 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,168 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,168 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,169 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,169 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,169 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:04,170 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:04,170 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:04,171 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:04,171 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:04,172 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:04,172 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:04,172 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:04,173 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:04,173 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:04,174 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:04,175 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:04,175 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:04,176 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:04,177 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:04,177 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:04,178 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:04,179 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:04,721 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:04,724 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-19 13:11:04,726 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 13:11:05,508 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:05,509 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:05,515 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0001_000001 (auth:SIMPLE) 2023-07-19 13:11:06,038 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:06,977 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:11:10,579 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:12,856 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:15,452 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:16,973 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:16,975 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:16,984 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-19 13:11:16,984 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:16,985 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:16,985 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 13:11:16,986 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 13:11:16,986 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 13:11:16,986 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-19 13:11:16,986 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-19 13:11:16,986 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772263040/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-19 13:11:16,996 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-19 13:11:16,997 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-19 13:11:16,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 13:11:17,007 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772277007"}]},"ts":"1689772277007"} 2023-07-19 13:11:17,009 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 13:11:17,011 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-19 13:11:17,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, UNASSIGN}] 2023-07-19 13:11:17,013 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, UNASSIGN 2023-07-19 13:11:17,015 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, UNASSIGN 2023-07-19 13:11:17,016 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a717c47d65a1733e78a1f808226d87fa, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:17,018 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9c32fc894bb41ab4835b1b5edbacb8cf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:17,018 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772277018"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772277018"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772277018"}]},"ts":"1689772277018"} 2023-07-19 13:11:17,019 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772277016"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772277016"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772277016"}]},"ts":"1689772277016"} 2023-07-19 13:11:17,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 9c32fc894bb41ab4835b1b5edbacb8cf, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:11:17,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure a717c47d65a1733e78a1f808226d87fa, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:11:17,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 13:11:17,173 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:17,173 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9c32fc894bb41ab4835b1b5edbacb8cf, disabling compactions & flushes 2023-07-19 13:11:17,174 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:17,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:17,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. after waiting 0 ms 2023-07-19 13:11:17,174 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:17,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:17,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a717c47d65a1733e78a1f808226d87fa, disabling compactions & flushes 2023-07-19 13:11:17,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:17,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:17,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. after waiting 0 ms 2023-07-19 13:11:17,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:17,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:17,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:17,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf. 2023-07-19 13:11:17,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9c32fc894bb41ab4835b1b5edbacb8cf: 2023-07-19 13:11:17,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:17,195 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:17,196 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa. 2023-07-19 13:11:17,196 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a717c47d65a1733e78a1f808226d87fa: 2023-07-19 13:11:17,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:17,198 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=9c32fc894bb41ab4835b1b5edbacb8cf, regionState=CLOSED 2023-07-19 13:11:17,198 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772277198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772277198"}]},"ts":"1689772277198"} 2023-07-19 13:11:17,199 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=a717c47d65a1733e78a1f808226d87fa, regionState=CLOSED 2023-07-19 13:11:17,199 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689772277199"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772277199"}]},"ts":"1689772277199"} 2023-07-19 13:11:17,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:17,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-19 13:11:17,203 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 9c32fc894bb41ab4835b1b5edbacb8cf, server=jenkins-hbase4.apache.org,39417,1689772232852 in 180 msec 2023-07-19 13:11:17,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-19 13:11:17,204 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure a717c47d65a1733e78a1f808226d87fa, server=jenkins-hbase4.apache.org,34931,1689772233028 in 179 msec 2023-07-19 13:11:17,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=9c32fc894bb41ab4835b1b5edbacb8cf, UNASSIGN in 191 msec 2023-07-19 13:11:17,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-19 13:11:17,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a717c47d65a1733e78a1f808226d87fa, UNASSIGN in 192 msec 2023-07-19 13:11:17,207 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772277207"}]},"ts":"1689772277207"} 2023-07-19 13:11:17,209 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 13:11:17,210 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-19 13:11:17,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 214 msec 2023-07-19 13:11:17,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-19 13:11:17,307 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-19 13:11:17,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-19 13:11:17,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,312 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-19 13:11:17,313 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,315 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-19 13:11:17,319 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:17,319 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:17,322 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/recovered.edits] 2023-07-19 13:11:17,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:17,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:17,324 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,325 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:17,325 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,326 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/recovered.edits] 2023-07-19 13:11:17,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 13:11:17,331 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf/947a85c585224d9ea14a670344cac72a to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/cf/947a85c585224d9ea14a670344cac72a 2023-07-19 13:11:17,332 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf/12d1ec53a58b48e79c175d7fb2a10edb to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/cf/12d1ec53a58b48e79c175d7fb2a10edb 2023-07-19 13:11:17,335 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf/recovered.edits/9.seqid 2023-07-19 13:11:17,336 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa/recovered.edits/9.seqid 2023-07-19 13:11:17,336 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/9c32fc894bb41ab4835b1b5edbacb8cf 2023-07-19 13:11:17,337 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemState/a717c47d65a1733e78a1f808226d87fa 2023-07-19 13:11:17,337 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-19 13:11:17,343 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,345 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-19 13:11:17,350 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-19 13:11:17,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-19 13:11:17,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772277352"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:17,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772277352"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:17,354 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:11:17,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9c32fc894bb41ab4835b1b5edbacb8cf, NAME => 'testtb-testExportFileSystemState,,1689772261704.9c32fc894bb41ab4835b1b5edbacb8cf.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a717c47d65a1733e78a1f808226d87fa, NAME => 'testtb-testExportFileSystemState,1,1689772261704.a717c47d65a1733e78a1f808226d87fa.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:11:17,354 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-19 13:11:17,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772277354"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:17,358 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-19 13:11:17,360 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-19 13:11:17,362 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 52 msec 2023-07-19 13:11:17,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-19 13:11:17,428 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-19 13:11:17,436 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-19 13:11:17,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-19 13:11:17,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-19 13:11:17,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-19 13:11:17,470 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=767 (was 755) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:34975 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1418734604_1 at /127.0.0.1:46794 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:46824 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1951 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x4082387e-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:35138 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:44793 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4082387e-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1191660693_17 at /127.0.0.1:35414 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 916) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=354 (was 360), ProcessCount=186 (was 183) - ProcessCount LEAK? -, AvailableMemoryMB=2922 (was 3108) 2023-07-19 13:11:17,470 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-19 13:11:17,498 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=354, ProcessCount=186, AvailableMemoryMB=2921 2023-07-19 13:11:17,498 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-07-19 13:11:17,500 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:11:17,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:17,505 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:17,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-19 13:11:17,506 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:17,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:17,510 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,510 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,511 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b empty. 2023-07-19 13:11:17,511 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 empty. 2023-07-19 13:11:17,511 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,512 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,512 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 13:11:17,537 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:17,539 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 41372b9c8f46378034466cc173b9e62b, NAME => 'testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:17,539 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 61a3e6199150b8530eb52c65e49207f7, NAME => 'testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:17,580 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:17,580 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 41372b9c8f46378034466cc173b9e62b, disabling compactions & flushes 2023-07-19 13:11:17,580 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,580 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,580 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. after waiting 0 ms 2023-07-19 13:11:17,580 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,580 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,581 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 41372b9c8f46378034466cc173b9e62b: 2023-07-19 13:11:17,586 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:17,586 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 61a3e6199150b8530eb52c65e49207f7, disabling compactions & flushes 2023-07-19 13:11:17,586 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,586 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,586 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. after waiting 0 ms 2023-07-19 13:11:17,586 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,586 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,586 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 61a3e6199150b8530eb52c65e49207f7: 2023-07-19 13:11:17,589 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:17,590 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772277590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772277590"}]},"ts":"1689772277590"} 2023-07-19 13:11:17,590 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772277590"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772277590"}]},"ts":"1689772277590"} 2023-07-19 13:11:17,592 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:17,593 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:17,594 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772277594"}]},"ts":"1689772277594"} 2023-07-19 13:11:17,595 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-19 13:11:17,599 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:17,601 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:17,601 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:17,601 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:17,601 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:17,601 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, ASSIGN}] 2023-07-19 13:11:17,605 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, ASSIGN 2023-07-19 13:11:17,605 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, ASSIGN 2023-07-19 13:11:17,606 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33135,1689772232949; forceNewPlan=false, retain=false 2023-07-19 13:11:17,606 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39417,1689772232852; forceNewPlan=false, retain=false 2023-07-19 13:11:17,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:17,756 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:17,760 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=61a3e6199150b8530eb52c65e49207f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:17,760 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=41372b9c8f46378034466cc173b9e62b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:17,760 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772277760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772277760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772277760"}]},"ts":"1689772277760"} 2023-07-19 13:11:17,760 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772277760"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772277760"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772277760"}]},"ts":"1689772277760"} 2023-07-19 13:11:17,762 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 61a3e6199150b8530eb52c65e49207f7, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:11:17,763 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 41372b9c8f46378034466cc173b9e62b, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:11:17,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:17,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41372b9c8f46378034466cc173b9e62b, NAME => 'testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:11:17,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. service=AccessControlService 2023-07-19 13:11:17,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61a3e6199150b8530eb52c65e49207f7, NAME => 'testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:11:17,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. service=AccessControlService 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,929 INFO [StoreOpener-41372b9c8f46378034466cc173b9e62b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,929 INFO [StoreOpener-61a3e6199150b8530eb52c65e49207f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,930 DEBUG [StoreOpener-41372b9c8f46378034466cc173b9e62b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf 2023-07-19 13:11:17,931 DEBUG [StoreOpener-41372b9c8f46378034466cc173b9e62b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf 2023-07-19 13:11:17,931 DEBUG [StoreOpener-61a3e6199150b8530eb52c65e49207f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf 2023-07-19 13:11:17,931 DEBUG [StoreOpener-61a3e6199150b8530eb52c65e49207f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf 2023-07-19 13:11:17,931 INFO [StoreOpener-41372b9c8f46378034466cc173b9e62b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41372b9c8f46378034466cc173b9e62b columnFamilyName cf 2023-07-19 13:11:17,931 INFO [StoreOpener-61a3e6199150b8530eb52c65e49207f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61a3e6199150b8530eb52c65e49207f7 columnFamilyName cf 2023-07-19 13:11:17,932 INFO [StoreOpener-41372b9c8f46378034466cc173b9e62b-1] regionserver.HStore(310): Store=41372b9c8f46378034466cc173b9e62b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:17,932 INFO [StoreOpener-61a3e6199150b8530eb52c65e49207f7-1] regionserver.HStore(310): Store=61a3e6199150b8530eb52c65e49207f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:17,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,935 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:17,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:17,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:17,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:17,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 61a3e6199150b8530eb52c65e49207f7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59029059, jitterRate=-0.12039847671985626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:17,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 41372b9c8f46378034466cc173b9e62b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62838170, jitterRate=-0.06363829970359802}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:17,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 61a3e6199150b8530eb52c65e49207f7: 2023-07-19 13:11:17,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 41372b9c8f46378034466cc173b9e62b: 2023-07-19 13:11:17,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b., pid=46, masterSystemTime=1689772277916 2023-07-19 13:11:17,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7., pid=45, masterSystemTime=1689772277915 2023-07-19 13:11:17,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:17,947 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=41372b9c8f46378034466cc173b9e62b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:17,947 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772277947"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772277947"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772277947"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772277947"}]},"ts":"1689772277947"} 2023-07-19 13:11:17,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:17,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=61a3e6199150b8530eb52c65e49207f7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:17,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772277948"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772277948"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772277948"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772277948"}]},"ts":"1689772277948"} 2023-07-19 13:11:17,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-19 13:11:17,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 41372b9c8f46378034466cc173b9e62b, server=jenkins-hbase4.apache.org,39417,1689772232852 in 186 msec 2023-07-19 13:11:17,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-19 13:11:17,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, ASSIGN in 351 msec 2023-07-19 13:11:17,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 61a3e6199150b8530eb52c65e49207f7, server=jenkins-hbase4.apache.org,33135,1689772232949 in 189 msec 2023-07-19 13:11:17,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-19 13:11:17,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, ASSIGN in 353 msec 2023-07-19 13:11:17,957 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:17,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772277957"}]},"ts":"1689772277957"} 2023-07-19 13:11:17,959 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-19 13:11:17,961 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:17,961 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-19 13:11:17,964 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 13:11:17,965 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,965 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,965 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,965 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:17,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:17,966 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:17,967 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:17,967 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:17,968 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 466 msec 2023-07-19 13:11:18,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-19 13:11:18,112 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-19 13:11:18,112 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-19 13:11:18,112 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:18,116 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-19 13:11:18,116 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:18,116 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-19 13:11:18,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:18,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772278120 (current time:1689772278120). 2023-07-19 13:11:18,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:18,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x431c5a09 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:18,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@109ac492, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:18,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:18,142 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:18,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x431c5a09 to 127.0.0.1:64397 2023-07-19 13:11:18,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:18,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x6a99d3ef to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:18,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b7400a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:18,254 DEBUG [hconnection-0xd0ce30f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:18,256 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:18,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a99d3ef to 127.0.0.1:64397 2023-07-19 13:11:18,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:18,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 13:11:18,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:18,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:18,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:18,266 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:18,267 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689772878267 2023-07-19 13:11:18,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:18,267 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 13:11:18,268 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:18,268 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:18,269 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:18,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:18,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-19 13:11:18,271 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:18,272 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689772878272 2023-07-19 13:11:18,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,282 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-19 13:11:18,282 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,283 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 13:11:18,283 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 13:11:18,283 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,283 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,286 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,286 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,286 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,286 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,286 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,286 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,287 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,287 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,287 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,288 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:18,288 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:18,288 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,288 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,289 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:18,289 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,289 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:18,290 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:18,290 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:18,290 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:18,289 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:18,290 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,290 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:18,293 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:18,293 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:18,293 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:18,293 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:18,294 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,294 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,295 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:18,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:18,295 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,296 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b655cbe[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:18,299 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b655cbe[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:18,299 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 13:11:18,299 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:18,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,300 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:18,300 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:18,301 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:18,301 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:18,301 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:18,301 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. started... 2023-07-19 13:11:18,301 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:18,301 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:18,301 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. started... 2023-07-19 13:11:18,302 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61a3e6199150b8530eb52c65e49207f7: 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41372b9c8f46378034466cc173b9e62b: 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:18,303 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:18,308 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:18,308 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,308 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:18,333 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. completed. 2023-07-19 13:11:18,334 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:18,333 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. completed. 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,334 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:18,334 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:18,335 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:18,335 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:18,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:18,336 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,336 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,337 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:18,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:11:18,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 13:11:18,345 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-19 13:11:18,345 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:18,345 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:18,345 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,345 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,347 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,347 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,348 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,348 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,351 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,351 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,352 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,354 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,355 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,355 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,357 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,355 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,355 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,359 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,359 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,359 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,359 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,359 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,360 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,368 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:18,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:18,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:18,369 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:18,380 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,404 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 13:11:18,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,404 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:18,404 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689772278267Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689772278355 (+88 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689772278357 (+2 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689772278363 (+6 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689772278375 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689772278404 (+29 ms) 2023-07-19 13:11:18,409 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:18,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 141 msec 2023-07-19 13:11:18,570 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:18,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:18,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:18,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33135] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:18,580 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:18,582 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-19 13:11:18,583 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:18,584 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:18,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:18,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772278597 (current time:1689772278597). 2023-07-19 13:11:18,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:18,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x1d8ece76 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@370b8967, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:18,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:18,615 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:18,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1d8ece76 to 127.0.0.1:64397 2023-07-19 13:11:18,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:18,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x29fbef91 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:18,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@426d69a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:18,625 DEBUG [hconnection-0x2946903d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:18,628 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29fbef91 to 127.0.0.1:64397 2023-07-19 13:11:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:18,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-19 13:11:18,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:18,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:18,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:18,638 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:18,639 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689772878639 2023-07-19 13:11:18,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-19 13:11:18,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-19 13:11:18,641 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:18,641 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:18,642 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-19 13:11:18,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:18,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-19 13:11:18,645 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:18,645 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689772878645 2023-07-19 13:11:18,669 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-19 13:11:18,669 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-19 13:11:18,669 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,671 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-19 13:11:18,671 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-19 13:11:18,672 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,672 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,674 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,674 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,674 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,674 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,675 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,675 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 13:11:18,676 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,676 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:18,676 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:18,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 13:11:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 13:11:18,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-19 13:11:18,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,677 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:18,678 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:18,679 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-19 13:11:18,679 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:18,679 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:18,679 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-19 13:11:18,680 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:18,680 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-19 13:11:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:18,681 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:18,682 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-19 13:11:18,682 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-19 13:11:18,682 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:18,682 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-19 13:11:18,683 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,683 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,684 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,684 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:18,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:18,685 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,686 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:18,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3f0411[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-19 13:11:18,691 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b3f0411[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:18,691 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-19 13:11:18,691 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,693 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,693 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,693 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,694 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:18,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-19 13:11:18,694 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:18,694 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. started... 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:18,694 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,694 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:18,694 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 61a3e6199150b8530eb52c65e49207f7 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-19 13:11:18,694 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:18,695 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:18,695 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:18,695 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. started... 2023-07-19 13:11:18,695 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41372b9c8f46378034466cc173b9e62b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-19 13:11:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,697 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:18,728 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/.tmp/cf/f7acd73e6aa64ef7b662af034903cb89 2023-07-19 13:11:18,728 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/.tmp/cf/5d7a5178edc04369821a73699768dc3a 2023-07-19 13:11:18,737 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/.tmp/cf/5d7a5178edc04369821a73699768dc3a as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf/5d7a5178edc04369821a73699768dc3a 2023-07-19 13:11:18,737 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/.tmp/cf/f7acd73e6aa64ef7b662af034903cb89 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf/f7acd73e6aa64ef7b662af034903cb89 2023-07-19 13:11:18,742 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:18,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:18,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:18,744 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:18,744 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf/f7acd73e6aa64ef7b662af034903cb89, entries=2, sequenceid=6, filesize=5.0 K 2023-07-19 13:11:18,744 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf/5d7a5178edc04369821a73699768dc3a, entries=48, sequenceid=6, filesize=8.1 K 2023-07-19 13:11:18,745 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 61a3e6199150b8530eb52c65e49207f7 in 51ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:18,745 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 41372b9c8f46378034466cc173b9e62b in 50ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:18,745 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 13:11:18,745 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-19 13:11:18,747 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 61a3e6199150b8530eb52c65e49207f7: 2023-07-19 13:11:18,747 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41372b9c8f46378034466cc173b9e62b: 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf/f7acd73e6aa64ef7b662af034903cb89] hfiles 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf/f7acd73e6aa64ef7b662af034903cb89 for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf/5d7a5178edc04369821a73699768dc3a] hfiles 2023-07-19 13:11:18,748 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf/5d7a5178edc04369821a73699768dc3a for snapshot=snaptb0-testConsecutiveExports 2023-07-19 13:11:18,773 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. completed. 2023-07-19 13:11:18,773 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:18,773 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:18,774 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. completed. 2023-07-19 13:11:18,774 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:18,775 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,775 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,778 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-19 13:11:18,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,778 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-19 13:11:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:11:18,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-19 13:11:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:11:18,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-19 13:11:18,787 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-19 13:11:18,787 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:18,787 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:18,787 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-19 13:11:18,788 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:18,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:18,792 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,792 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:18,793 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:18,795 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-19 13:11:18,795 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,796 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,802 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:18,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:18,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:18,802 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-19 13:11:18,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,802 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-19 13:11:18,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,805 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-19 13:11:18,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,862 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689772278639Consolidate snapshot: snaptb0-testConsecutiveExports at 1689772278805 (+166 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689772278805Writing data manifest for snaptb0-testConsecutiveExports at 1689772278816 (+11 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689772278828 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689772278861 (+33 ms) 2023-07-19 13:11:18,864 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-19 13:11:18,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 225 msec 2023-07-19 13:11:18,944 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:18,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-19 13:11:18,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:18,946 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945 2023-07-19 13:11:18,946 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:18,968 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:18,968 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@183a41d4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,968 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 13:11:18,976 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:18,988 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:18,988 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:18,989 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:18,989 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,900 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-5553935767579471405.jar 2023-07-19 13:11:19,901 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,901 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,970 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-6051268022429306455.jar 2023-07-19 13:11:19,971 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,971 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,972 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,972 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,972 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,973 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:19,973 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:19,973 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:19,974 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:19,974 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:19,975 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:19,977 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:19,977 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:19,977 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:19,978 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:19,978 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:19,979 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:19,979 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:19,980 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:19,980 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:19,980 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:19,981 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:19,982 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:20,430 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:20,433 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 13:11:20,435 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 13:11:21,627 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:21,628 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:21,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0002_000001 (auth:SIMPLE) 2023-07-19 13:11:22,524 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:22,800 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:11:26,940 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:29,215 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:31,850 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:33,642 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:33,642 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:33,646 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 13:11:33,646 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:33,647 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:33,647 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:33,649 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:33,649 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:33,649 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@189e5d06 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:33,650 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:33,650 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:33,652 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:33,684 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:33,684 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@357e08c4, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:33,684 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-19 13:11:33,696 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-19 13:11:33,717 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:33,717 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:33,718 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:33,718 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,712 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-6951038408060014273.jar 2023-07-19 13:11:34,713 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,713 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,782 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-9194070941815799322.jar 2023-07-19 13:11:34,782 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,783 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,783 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,783 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,784 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,784 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:34,784 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:34,785 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:34,785 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:34,786 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:34,786 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:34,786 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:34,787 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:34,787 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:34,787 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:34,788 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:34,789 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:34,790 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:34,790 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:34,790 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:34,791 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:35,181 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:35,184 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-19 13:11:35,186 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 13:11:38,047 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:38,047 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:38,051 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0003_000001 (auth:SIMPLE) 2023-07-19 13:11:38,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:42,797 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:45,076 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:48,448 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:50,424 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:11:50,424 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:11:50,460 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-19 13:11:50,460 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:11:50,461 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:11:50,461 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:50,472 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:50,473 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:50,473 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@189e5d06 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-19 13:11:50,473 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-19 13:11:50,473 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/local-export-1689772278945/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-19 13:11:50,494 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-19 13:11:50,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-19 13:11:50,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 13:11:50,502 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772310502"}]},"ts":"1689772310502"} 2023-07-19 13:11:50,504 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-19 13:11:50,506 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-19 13:11:50,507 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, UNASSIGN}] 2023-07-19 13:11:50,511 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, UNASSIGN 2023-07-19 13:11:50,512 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, UNASSIGN 2023-07-19 13:11:50,513 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=41372b9c8f46378034466cc173b9e62b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:50,513 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772310513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772310513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772310513"}]},"ts":"1689772310513"} 2023-07-19 13:11:50,514 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=61a3e6199150b8530eb52c65e49207f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:50,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772310513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772310513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772310513"}]},"ts":"1689772310513"} 2023-07-19 13:11:50,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 41372b9c8f46378034466cc173b9e62b, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:11:50,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 61a3e6199150b8530eb52c65e49207f7, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:11:50,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 13:11:50,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:50,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:50,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 61a3e6199150b8530eb52c65e49207f7, disabling compactions & flushes 2023-07-19 13:11:50,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:50,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 41372b9c8f46378034466cc173b9e62b, disabling compactions & flushes 2023-07-19 13:11:50,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:50,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:50,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. after waiting 0 ms 2023-07-19 13:11:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. after waiting 0 ms 2023-07-19 13:11:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:50,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:50,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:50,725 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:11:50,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7. 2023-07-19 13:11:50,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 61a3e6199150b8530eb52c65e49207f7: 2023-07-19 13:11:50,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:50,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:50,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b. 2023-07-19 13:11:50,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 41372b9c8f46378034466cc173b9e62b: 2023-07-19 13:11:50,738 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=61a3e6199150b8530eb52c65e49207f7, regionState=CLOSED 2023-07-19 13:11:50,738 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772310738"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772310738"}]},"ts":"1689772310738"} 2023-07-19 13:11:50,744 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=41372b9c8f46378034466cc173b9e62b, regionState=CLOSED 2023-07-19 13:11:50,744 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689772310744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772310744"}]},"ts":"1689772310744"} 2023-07-19 13:11:50,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:50,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-19 13:11:50,749 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 61a3e6199150b8530eb52c65e49207f7, server=jenkins-hbase4.apache.org,33135,1689772232949 in 225 msec 2023-07-19 13:11:50,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-19 13:11:50,751 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=61a3e6199150b8530eb52c65e49207f7, UNASSIGN in 242 msec 2023-07-19 13:11:50,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 41372b9c8f46378034466cc173b9e62b, server=jenkins-hbase4.apache.org,39417,1689772232852 in 232 msec 2023-07-19 13:11:50,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-19 13:11:50,756 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=41372b9c8f46378034466cc173b9e62b, UNASSIGN in 244 msec 2023-07-19 13:11:50,757 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772310757"}]},"ts":"1689772310757"} 2023-07-19 13:11:50,766 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-19 13:11:50,767 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-19 13:11:50,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 274 msec 2023-07-19 13:11:50,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-19 13:11:50,806 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-19 13:11:50,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-19 13:11:50,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,819 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-19 13:11:50,820 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,824 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-19 13:11:50,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,838 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 13:11:50,838 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 13:11:50,839 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:50,840 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-19 13:11:50,840 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-19 13:11:50,840 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:50,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 13:11:50,842 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:50,845 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:50,848 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/recovered.edits] 2023-07-19 13:11:50,848 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/recovered.edits] 2023-07-19 13:11:50,853 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf/f7acd73e6aa64ef7b662af034903cb89 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/cf/f7acd73e6aa64ef7b662af034903cb89 2023-07-19 13:11:50,856 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf/5d7a5178edc04369821a73699768dc3a to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/cf/5d7a5178edc04369821a73699768dc3a 2023-07-19 13:11:50,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7/recovered.edits/9.seqid 2023-07-19 13:11:50,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/61a3e6199150b8530eb52c65e49207f7 2023-07-19 13:11:50,861 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b/recovered.edits/9.seqid 2023-07-19 13:11:50,861 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testConsecutiveExports/41372b9c8f46378034466cc173b9e62b 2023-07-19 13:11:50,861 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-19 13:11:50,864 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,867 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-19 13:11:50,872 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-19 13:11:50,876 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,876 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-19 13:11:50,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772310876"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:50,876 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772310876"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:50,884 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:11:50,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 61a3e6199150b8530eb52c65e49207f7, NAME => 'testtb-testConsecutiveExports,,1689772277500.61a3e6199150b8530eb52c65e49207f7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 41372b9c8f46378034466cc173b9e62b, NAME => 'testtb-testConsecutiveExports,1,1689772277500.41372b9c8f46378034466cc173b9e62b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:11:50,885 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-19 13:11:50,885 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772310885"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:50,888 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-19 13:11:50,891 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-19 13:11:50,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 80 msec 2023-07-19 13:11:50,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-19 13:11:50,942 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-19 13:11:50,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-19 13:11:50,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-19 13:11:50,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-19 13:11:50,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-19 13:11:51,007 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=748 (was 767), OpenFileDescriptor=898 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=344 (was 354), ProcessCount=188 (was 186) - ProcessCount LEAK? -, AvailableMemoryMB=2888 (was 2921) 2023-07-19 13:11:51,008 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-19 13:11:51,043 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=898, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=188, AvailableMemoryMB=2880 2023-07-19 13:11:51,043 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-07-19 13:11:51,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:11:51,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:51,059 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:51,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-19 13:11:51,061 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:51,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:51,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,066 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 empty. 2023-07-19 13:11:51,066 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,067 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,067 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 empty. 2023-07-19 13:11:51,068 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,068 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 13:11:51,152 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:51,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:51,163 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 744c18afa44fa7ed60ee6b5c04d3a5e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:51,183 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 443c2fc178e374cadae14ce28a052932, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:51,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:51,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 744c18afa44fa7ed60ee6b5c04d3a5e1, disabling compactions & flushes 2023-07-19 13:11:51,287 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. after waiting 0 ms 2023-07-19 13:11:51,287 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,287 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 744c18afa44fa7ed60ee6b5c04d3a5e1: 2023-07-19 13:11:51,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:51,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 443c2fc178e374cadae14ce28a052932, disabling compactions & flushes 2023-07-19 13:11:51,296 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. after waiting 0 ms 2023-07-19 13:11:51,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,296 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 443c2fc178e374cadae14ce28a052932: 2023-07-19 13:11:51,299 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:51,300 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772311300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772311300"}]},"ts":"1689772311300"} 2023-07-19 13:11:51,301 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772311300"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772311300"}]},"ts":"1689772311300"} 2023-07-19 13:11:51,313 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:51,314 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:51,315 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772311315"}]},"ts":"1689772311315"} 2023-07-19 13:11:51,316 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-19 13:11:51,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:51,574 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:51,576 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:51,576 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:51,576 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:51,576 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:51,576 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, ASSIGN}] 2023-07-19 13:11:51,580 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, ASSIGN 2023-07-19 13:11:51,580 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, ASSIGN 2023-07-19 13:11:51,581 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39417,1689772232852; forceNewPlan=false, retain=false 2023-07-19 13:11:51,581 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1689772233028; forceNewPlan=false, retain=false 2023-07-19 13:11:51,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:51,732 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:51,735 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=443c2fc178e374cadae14ce28a052932, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:51,735 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=744c18afa44fa7ed60ee6b5c04d3a5e1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:51,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772311735"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772311735"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772311735"}]},"ts":"1689772311735"} 2023-07-19 13:11:51,735 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772311735"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772311735"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772311735"}]},"ts":"1689772311735"} 2023-07-19 13:11:51,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 744c18afa44fa7ed60ee6b5c04d3a5e1, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:11:51,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 443c2fc178e374cadae14ce28a052932, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:11:51,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 443c2fc178e374cadae14ce28a052932, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:11:51,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. service=AccessControlService 2023-07-19 13:11:51,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:51,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:51,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,921 INFO [StoreOpener-443c2fc178e374cadae14ce28a052932-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,926 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 744c18afa44fa7ed60ee6b5c04d3a5e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:11:51,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. service=AccessControlService 2023-07-19 13:11:51,927 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:51,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:51,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,927 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,927 DEBUG [StoreOpener-443c2fc178e374cadae14ce28a052932-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf 2023-07-19 13:11:51,927 DEBUG [StoreOpener-443c2fc178e374cadae14ce28a052932-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf 2023-07-19 13:11:51,929 INFO [StoreOpener-443c2fc178e374cadae14ce28a052932-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 443c2fc178e374cadae14ce28a052932 columnFamilyName cf 2023-07-19 13:11:51,930 INFO [StoreOpener-443c2fc178e374cadae14ce28a052932-1] regionserver.HStore(310): Store=443c2fc178e374cadae14ce28a052932/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:51,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,938 INFO [StoreOpener-744c18afa44fa7ed60ee6b5c04d3a5e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,940 DEBUG [StoreOpener-744c18afa44fa7ed60ee6b5c04d3a5e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf 2023-07-19 13:11:51,940 DEBUG [StoreOpener-744c18afa44fa7ed60ee6b5c04d3a5e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf 2023-07-19 13:11:51,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 443c2fc178e374cadae14ce28a052932 2023-07-19 13:11:51,941 INFO [StoreOpener-744c18afa44fa7ed60ee6b5c04d3a5e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 744c18afa44fa7ed60ee6b5c04d3a5e1 columnFamilyName cf 2023-07-19 13:11:51,945 INFO [StoreOpener-744c18afa44fa7ed60ee6b5c04d3a5e1-1] regionserver.HStore(310): Store=744c18afa44fa7ed60ee6b5c04d3a5e1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:51,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:51,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 443c2fc178e374cadae14ce28a052932; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68049714, jitterRate=0.014019757509231567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:51,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 443c2fc178e374cadae14ce28a052932: 2023-07-19 13:11:51,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932., pid=61, masterSystemTime=1689772311894 2023-07-19 13:11:51,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:11:51,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:51,964 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=443c2fc178e374cadae14ce28a052932, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:51,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772311964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772311964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772311964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772311964"}]},"ts":"1689772311964"} 2023-07-19 13:11:51,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-19 13:11:51,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 443c2fc178e374cadae14ce28a052932, server=jenkins-hbase4.apache.org,39417,1689772232852 in 225 msec 2023-07-19 13:11:51,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, ASSIGN in 393 msec 2023-07-19 13:11:51,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:51,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 744c18afa44fa7ed60ee6b5c04d3a5e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65430864, jitterRate=-0.025004148483276367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:51,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 744c18afa44fa7ed60ee6b5c04d3a5e1: 2023-07-19 13:11:51,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1., pid=60, masterSystemTime=1689772311893 2023-07-19 13:11:51,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:51,980 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=744c18afa44fa7ed60ee6b5c04d3a5e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:51,980 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772311980"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772311980"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772311980"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772311980"}]},"ts":"1689772311980"} 2023-07-19 13:11:51,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-19 13:11:51,985 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 744c18afa44fa7ed60ee6b5c04d3a5e1, server=jenkins-hbase4.apache.org,34931,1689772233028 in 243 msec 2023-07-19 13:11:51,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-19 13:11:51,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, ASSIGN in 409 msec 2023-07-19 13:11:51,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:51,989 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772311988"}]},"ts":"1689772311988"} 2023-07-19 13:11:51,994 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-19 13:11:51,997 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:51,997 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-19 13:11:52,000 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 13:11:52,003 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:52,003 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:52,003 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:52,004 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:52,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:52,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:52,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:52,007 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:52,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 952 msec 2023-07-19 13:11:52,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-19 13:11:52,168 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-19 13:11:52,168 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-19 13:11:52,169 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:52,190 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-19 13:11:52,190 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:52,190 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-19 13:11:52,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772312198 (current time:1689772312198). 2023-07-19 13:11:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:52,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x7d3100cd to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:52,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@740cebda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:52,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:52,228 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:52,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d3100cd to 127.0.0.1:64397 2023-07-19 13:11:52,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:52,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x68ffa45d to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:52,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dbde6e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:52,264 DEBUG [hconnection-0xefc9cb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:52,269 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:52,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68ffa45d to 127.0.0.1:64397 2023-07-19 13:11:52,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:52,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 13:11:52,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:52,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:52,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:52,280 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:52,289 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689772912289 2023-07-19 13:11:52,290 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:52,290 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:52,290 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:52,292 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:52,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:52,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 14 msec 2023-07-19 13:11:52,296 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:52,297 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689772912297 2023-07-19 13:11:52,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,320 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 13:11:52,320 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,321 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 13:11:52,321 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 13:11:52,321 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,321 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,323 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,323 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 13:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 13:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:52,325 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:52,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,326 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,326 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,326 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:52,326 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,326 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:52,334 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,333 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:52,334 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:52,334 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-19 13:11:52,334 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:52,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:52,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:52,335 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,337 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:52,337 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:52,337 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:52,338 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,343 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,343 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,345 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:52,345 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:52,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b40db4e[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:52,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@b40db4e[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:52,357 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 13:11:52,357 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,358 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,358 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,358 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:52,358 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,359 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:52,359 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:52,359 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:52,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,360 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,362 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:52,365 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:52,365 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,365 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:52,365 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,365 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:52,366 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:52,367 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:52,367 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:52,367 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. started... 2023-07-19 13:11:52,372 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:52,380 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 744c18afa44fa7ed60ee6b5c04d3a5e1: 2023-07-19 13:11:52,380 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:52,380 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:52,380 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. started... 2023-07-19 13:11:52,380 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,381 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:52,381 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:52,383 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 443c2fc178e374cadae14ce28a052932: 2023-07-19 13:11:52,383 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,383 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:52,383 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:11:52,390 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:52,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:52,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:52,392 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:52,430 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. completed. 2023-07-19 13:11:52,430 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:52,430 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:52,432 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,432 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,433 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,433 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:11:52,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 13:11:52,446 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. completed. 2023-07-19 13:11:52,447 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:52,447 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:52,452 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,452 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34931,1689772233028': 2023-07-19 13:11:52,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 13:11:52,459 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 13:11:52,459 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:52,459 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:52,459 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,459 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:52,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,461 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:52,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:52,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,462 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:52,463 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,464 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,466 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,467 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,467 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,471 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,472 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,471 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,471 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:52,472 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:52,474 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,474 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:52,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:52,474 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:52,474 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,474 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,474 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,474 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:52,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 13:11:52,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,548 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689772312290Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772312471 (+181 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772312471Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772312479 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689772312495 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689772312547 (+52 ms) 2023-07-19 13:11:52,551 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:52,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 259 msec 2023-07-19 13:11:52,592 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:52,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:52,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:52,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34931] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:52,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:11:52,612 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,612 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:52,614 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:11:52,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:52,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772312645 (current time:1689772312645). 2023-07-19 13:11:52,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:52,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x58e3936b to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:52,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fec775d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:52,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:52,663 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:52,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58e3936b to 127.0.0.1:64397 2023-07-19 13:11:52,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:52,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x3fc5125c to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:52,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b79b604, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:52,694 DEBUG [hconnection-0x174370a9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:52,696 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:52,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fc5125c to 127.0.0.1:64397 2023-07-19 13:11:52,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:52,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-19 13:11:52,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:52,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:52,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:52,711 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:52,712 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689772912712 2023-07-19 13:11:52,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-19 13:11:52,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,713 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:52,713 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:52,716 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-19 13:11:52,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:52,718 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-19 13:11:52,720 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:52,721 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689772912721 2023-07-19 13:11:52,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,766 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-19 13:11:52,766 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,772 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-19 13:11:52,772 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-19 13:11:52,772 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,774 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,781 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,781 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,781 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,781 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:52,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:52,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:52,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,785 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,785 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,785 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 13:11:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,786 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 13:11:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,787 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:52,787 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,787 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:52,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:52,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-19 13:11:52,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,790 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,790 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-19 13:11:52,790 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,791 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:52,791 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,793 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:52,793 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:52,793 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:52,793 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:52,793 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:52,793 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:52,797 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,797 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:52,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,799 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,800 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,800 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:52,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb952f4[Count = 1] remaining members to acquire global barrier 2023-07-19 13:11:52,802 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-19 13:11:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:52,804 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-19 13:11:52,804 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-19 13:11:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-19 13:11:52,813 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:52,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:52,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:52,815 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,815 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,815 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,816 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-19 13:11:52,818 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb952f4[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:52,818 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-19 13:11:52,819 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:52,820 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:52,820 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:52,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,820 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:52,821 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:52,820 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:52,821 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:52,821 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,821 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:52,821 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-19 13:11:52,823 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:52,823 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,823 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:52,826 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. started... 2023-07-19 13:11:52,826 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 744c18afa44fa7ed60ee6b5c04d3a5e1 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 13:11:52,826 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:52,837 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:52,836 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:52,837 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. started... 2023-07-19 13:11:52,837 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 443c2fc178e374cadae14ce28a052932 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 13:11:52,872 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/.tmp/cf/203a853c2af94f0ca56c9e3de1f3d39d 2023-07-19 13:11:52,888 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/.tmp/cf/203a853c2af94f0ca56c9e3de1f3d39d as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf/203a853c2af94f0ca56c9e3de1f3d39d 2023-07-19 13:11:52,890 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/.tmp/cf/5234e33b656f451aa99e60daf386e9ee 2023-07-19 13:11:52,896 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf/203a853c2af94f0ca56c9e3de1f3d39d, entries=45, sequenceid=6, filesize=7.9 K 2023-07-19 13:11:52,898 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/.tmp/cf/5234e33b656f451aa99e60daf386e9ee as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf/5234e33b656f451aa99e60daf386e9ee 2023-07-19 13:11:52,898 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 443c2fc178e374cadae14ce28a052932 in 61ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:52,898 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-19 13:11:52,899 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 443c2fc178e374cadae14ce28a052932: 2023-07-19 13:11:52,899 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,899 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:52,899 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf/203a853c2af94f0ca56c9e3de1f3d39d] hfiles 2023-07-19 13:11:52,899 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf/203a853c2af94f0ca56c9e3de1f3d39d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,905 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf/5234e33b656f451aa99e60daf386e9ee, entries=5, sequenceid=6, filesize=5.2 K 2023-07-19 13:11:52,907 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 744c18afa44fa7ed60ee6b5c04d3a5e1 in 81ms, sequenceid=6, compaction requested=false 2023-07-19 13:11:52,912 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 744c18afa44fa7ed60ee6b5c04d3a5e1: 2023-07-19 13:11:52,912 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,912 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:52,912 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf/5234e33b656f451aa99e60daf386e9ee] hfiles 2023-07-19 13:11:52,912 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf/5234e33b656f451aa99e60daf386e9ee for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,951 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. completed. 2023-07-19 13:11:52,951 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:11:52,951 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:52,951 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:52,951 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,952 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:52,952 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:52,953 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:52,953 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,953 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:52,955 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:52,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:52,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:52,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:52,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:11:52,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-19 13:11:52,992 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. completed. 2023-07-19 13:11:52,993 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:11:52,993 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:52,993 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:52,993 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,993 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-19 13:11:52,993 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:52,995 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:52,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:52,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:52,996 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-19 13:11:52,996 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:52,996 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-19 13:11:52,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:52,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34931,1689772233028': 2023-07-19 13:11:53,003 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-19 13:11:53,003 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-19 13:11:53,003 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:53,003 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:53,003 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,003 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:53,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:53,013 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:53,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,014 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:53,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,015 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:53,015 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:53,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:53,016 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,017 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:11:53,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:53,019 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,022 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,022 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:53,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,028 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:53,028 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:53,028 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:53,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:53,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:53,029 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:53,028 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:53,029 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:53,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:53,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:53,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:53,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,033 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:53,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,033 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,035 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:53,035 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,035 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,035 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:53,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:53,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,038 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-19 13:11:53,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-19 13:11:53,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,132 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:11:53,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689772312713Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689772313033 (+320 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689772313035 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689772313044 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689772313062 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689772313131 (+69 ms) 2023-07-19 13:11:53,135 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-19 13:11:53,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 420 msec 2023-07-19 13:11:53,317 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:53,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-19 13:11:53,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:53,357 DEBUG [Listener at jenkins-hbase4.apache.org/34975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:53,361 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60202, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:53,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33135] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 13:11:53,363 DEBUG [Listener at jenkins-hbase4.apache.org/34975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:53,368 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:53,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34931] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 13:11:53,368 DEBUG [Listener at jenkins-hbase4.apache.org/34975] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-19 13:11:53,371 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-19 13:11:53,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-19 13:11:53,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:11:53,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:53,377 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:11:53,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-19 13:11:53,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:53,379 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:11:53,382 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,383 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,383 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 empty. 2023-07-19 13:11:53,383 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 empty. 2023-07-19 13:11:53,383 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,384 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,384 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 13:11:53,399 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-19 13:11:53,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 517815623ded56829357f904dc8a1903, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:53,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 27da18df625b5c683dc845d7fe439bf2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:11:53,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:53,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 517815623ded56829357f904dc8a1903, disabling compactions & flushes 2023-07-19 13:11:53,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. after waiting 0 ms 2023-07-19 13:11:53,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,423 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,423 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 517815623ded56829357f904dc8a1903: 2023-07-19 13:11:53,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:53,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 27da18df625b5c683dc845d7fe439bf2, disabling compactions & flushes 2023-07-19 13:11:53,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. after waiting 0 ms 2023-07-19 13:11:53,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,426 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 27da18df625b5c683dc845d7fe439bf2: 2023-07-19 13:11:53,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:11:53,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772313432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772313432"}]},"ts":"1689772313432"} 2023-07-19 13:11:53,432 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772313432"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772313432"}]},"ts":"1689772313432"} 2023-07-19 13:11:53,437 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:11:53,455 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:11:53,455 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772313455"}]},"ts":"1689772313455"} 2023-07-19 13:11:53,457 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-19 13:11:53,460 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:11:53,461 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:11:53,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:11:53,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:11:53,462 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:11:53,462 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, ASSIGN}] 2023-07-19 13:11:53,465 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, ASSIGN 2023-07-19 13:11:53,465 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, ASSIGN 2023-07-19 13:11:53,466 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33135,1689772232949; forceNewPlan=false, retain=false 2023-07-19 13:11:53,466 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1689772233028; forceNewPlan=false, retain=false 2023-07-19 13:11:53,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:53,617 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:11:53,620 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=517815623ded56829357f904dc8a1903, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,620 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=27da18df625b5c683dc845d7fe439bf2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772313620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772313620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772313620"}]},"ts":"1689772313620"} 2023-07-19 13:11:53,620 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772313620"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772313620"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772313620"}]},"ts":"1689772313620"} 2023-07-19 13:11:53,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 517815623ded56829357f904dc8a1903, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:11:53,627 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 27da18df625b5c683dc845d7fe439bf2, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:11:53,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:53,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 517815623ded56829357f904dc8a1903, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.', STARTKEY => '', ENDKEY => '2'} 2023-07-19 13:11:53,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. service=AccessControlService 2023-07-19 13:11:53,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:53,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:53,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27da18df625b5c683dc845d7fe439bf2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.', STARTKEY => '2', ENDKEY => ''} 2023-07-19 13:11:53,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. service=AccessControlService 2023-07-19 13:11:53,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:53,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:53,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,784 INFO [StoreOpener-517815623ded56829357f904dc8a1903-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,785 INFO [StoreOpener-27da18df625b5c683dc845d7fe439bf2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,786 DEBUG [StoreOpener-517815623ded56829357f904dc8a1903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf 2023-07-19 13:11:53,786 DEBUG [StoreOpener-517815623ded56829357f904dc8a1903-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf 2023-07-19 13:11:53,786 INFO [StoreOpener-517815623ded56829357f904dc8a1903-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 517815623ded56829357f904dc8a1903 columnFamilyName cf 2023-07-19 13:11:53,787 DEBUG [StoreOpener-27da18df625b5c683dc845d7fe439bf2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf 2023-07-19 13:11:53,787 DEBUG [StoreOpener-27da18df625b5c683dc845d7fe439bf2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf 2023-07-19 13:11:53,787 INFO [StoreOpener-517815623ded56829357f904dc8a1903-1] regionserver.HStore(310): Store=517815623ded56829357f904dc8a1903/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:53,787 INFO [StoreOpener-27da18df625b5c683dc845d7fe439bf2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27da18df625b5c683dc845d7fe439bf2 columnFamilyName cf 2023-07-19 13:11:53,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,788 INFO [StoreOpener-27da18df625b5c683dc845d7fe439bf2-1] regionserver.HStore(310): Store=27da18df625b5c683dc845d7fe439bf2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:53,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,792 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 517815623ded56829357f904dc8a1903 2023-07-19 13:11:53,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:53,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:53,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 517815623ded56829357f904dc8a1903; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63647955, jitterRate=-0.0515715628862381}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:53,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 517815623ded56829357f904dc8a1903: 2023-07-19 13:11:53,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:11:53,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903., pid=69, masterSystemTime=1689772313778 2023-07-19 13:11:53,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27da18df625b5c683dc845d7fe439bf2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72154759, jitterRate=0.07518969476222992}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:53,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27da18df625b5c683dc845d7fe439bf2: 2023-07-19 13:11:53,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2., pid=70, masterSystemTime=1689772313779 2023-07-19 13:11:53,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,802 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:53,802 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=517815623ded56829357f904dc8a1903, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:53,802 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772313802"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772313802"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772313802"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772313802"}]},"ts":"1689772313802"} 2023-07-19 13:11:53,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:53,805 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=27da18df625b5c683dc845d7fe439bf2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:53,805 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772313805"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772313805"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772313805"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772313805"}]},"ts":"1689772313805"} 2023-07-19 13:11:53,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-19 13:11:53,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 517815623ded56829357f904dc8a1903, server=jenkins-hbase4.apache.org,33135,1689772232949 in 185 msec 2023-07-19 13:11:53,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-19 13:11:53,811 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 27da18df625b5c683dc845d7fe439bf2, server=jenkins-hbase4.apache.org,34931,1689772233028 in 182 msec 2023-07-19 13:11:53,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, ASSIGN in 348 msec 2023-07-19 13:11:53,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-19 13:11:53,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, ASSIGN in 349 msec 2023-07-19 13:11:53,816 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:11:53,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772313816"}]},"ts":"1689772313816"} 2023-07-19 13:11:53,818 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-19 13:11:53,822 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:11:53,822 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-19 13:11:53,824 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 13:11:53,826 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:53,826 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:53,826 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:53,826 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:11:53,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,829 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-19 13:11:53,831 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 454 msec 2023-07-19 13:11:53,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-19 13:11:53,982 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-19 13:11:54,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 517815623ded56829357f904dc8a1903, 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:54,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[517815623ded56829357f904dc8a1903, 27da18df625b5c683dc845d7fe439bf2], force=true 2023-07-19 13:11:54,030 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[517815623ded56829357f904dc8a1903, 27da18df625b5c683dc845d7fe439bf2], force=true 2023-07-19 13:11:54,030 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[517815623ded56829357f904dc8a1903, 27da18df625b5c683dc845d7fe439bf2], force=true 2023-07-19 13:11:54,030 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[517815623ded56829357f904dc8a1903, 27da18df625b5c683dc845d7fe439bf2], force=true 2023-07-19 13:11:54,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:54,080 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, UNASSIGN}] 2023-07-19 13:11:54,082 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, UNASSIGN 2023-07-19 13:11:54,083 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, UNASSIGN 2023-07-19 13:11:54,084 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=517815623ded56829357f904dc8a1903, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:54,084 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=27da18df625b5c683dc845d7fe439bf2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:54,085 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772314084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772314084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772314084"}]},"ts":"1689772314084"} 2023-07-19 13:11:54,085 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772314084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772314084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772314084"}]},"ts":"1689772314084"} 2023-07-19 13:11:54,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 517815623ded56829357f904dc8a1903, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:11:54,088 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 27da18df625b5c683dc845d7fe439bf2, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:11:54,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:54,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 517815623ded56829357f904dc8a1903 2023-07-19 13:11:54,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 517815623ded56829357f904dc8a1903, disabling compactions & flushes 2023-07-19 13:11:54,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:54,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:54,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. after waiting 0 ms 2023-07-19 13:11:54,242 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:54,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 517815623ded56829357f904dc8a1903 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 13:11:54,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27da18df625b5c683dc845d7fe439bf2, disabling compactions & flushes 2023-07-19 13:11:54,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. after waiting 0 ms 2023-07-19 13:11:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:54,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 27da18df625b5c683dc845d7fe439bf2 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-19 13:11:54,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/.tmp/cf/30fd491cf2c646a0a11a29af6dd50dac 2023-07-19 13:11:54,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/.tmp/cf/86102157b276488ba3773335a8483b47 2023-07-19 13:11:54,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/.tmp/cf/86102157b276488ba3773335a8483b47 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf/86102157b276488ba3773335a8483b47 2023-07-19 13:11:54,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/.tmp/cf/30fd491cf2c646a0a11a29af6dd50dac as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf/30fd491cf2c646a0a11a29af6dd50dac 2023-07-19 13:11:54,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf/86102157b276488ba3773335a8483b47, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 13:11:54,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 27da18df625b5c683dc845d7fe439bf2 in 65ms, sequenceid=5, compaction requested=false 2023-07-19 13:11:54,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 13:11:54,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf/30fd491cf2c646a0a11a29af6dd50dac, entries=1, sequenceid=5, filesize=4.7 K 2023-07-19 13:11:54,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 517815623ded56829357f904dc8a1903 in 81ms, sequenceid=5, compaction requested=false 2023-07-19 13:11:54,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:54,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 13:11:54,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:54,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2. 2023-07-19 13:11:54,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27da18df625b5c683dc845d7fe439bf2: 2023-07-19 13:11:54,352 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-19 13:11:54,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:11:54,353 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=27da18df625b5c683dc845d7fe439bf2, regionState=CLOSED 2023-07-19 13:11:54,353 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772314353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772314353"}]},"ts":"1689772314353"} 2023-07-19 13:11:54,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:11:54,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903. 2023-07-19 13:11:54,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 517815623ded56829357f904dc8a1903: 2023-07-19 13:11:54,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 517815623ded56829357f904dc8a1903 2023-07-19 13:11:54,360 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=517815623ded56829357f904dc8a1903, regionState=CLOSED 2023-07-19 13:11:54,360 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689772314360"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772314360"}]},"ts":"1689772314360"} 2023-07-19 13:11:54,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-19 13:11:54,362 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 27da18df625b5c683dc845d7fe439bf2, server=jenkins-hbase4.apache.org,34931,1689772233028 in 270 msec 2023-07-19 13:11:54,366 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=27da18df625b5c683dc845d7fe439bf2, UNASSIGN in 282 msec 2023-07-19 13:11:54,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-19 13:11:54,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 517815623ded56829357f904dc8a1903, server=jenkins-hbase4.apache.org,33135,1689772232949 in 279 msec 2023-07-19 13:11:54,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-19 13:11:54,371 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=517815623ded56829357f904dc8a1903, UNASSIGN in 303 msec 2023-07-19 13:11:54,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:54,678 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0004_000001 (auth:SIMPLE) 2023-07-19 13:11:54,911 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-19 13:11:54,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313373.517815623ded56829357f904dc8a1903.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:54,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689772313373.27da18df625b5c683dc845d7fe439bf2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:54,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-19 13:11:54,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, ASSIGN}] 2023-07-19 13:11:54,981 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, ASSIGN 2023-07-19 13:11:54,987 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33135,1689772232949; forceNewPlan=false, retain=false 2023-07-19 13:11:55,137 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-19 13:11:55,139 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b94e00e035e2c4dda44cadecc5cec1b8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:55,140 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772315139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772315139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772315139"}]},"ts":"1689772315139"} 2023-07-19 13:11:55,142 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure b94e00e035e2c4dda44cadecc5cec1b8, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:11:55,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:55,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:11:55,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b94e00e035e2c4dda44cadecc5cec1b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.', STARTKEY => '', ENDKEY => ''} 2023-07-19 13:11:55,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. service=AccessControlService 2023-07-19 13:11:55,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:11:55,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:11:55,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,300 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/.regioninfo 2023-07-19 13:11:55,326 INFO [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,327 DEBUG [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf 2023-07-19 13:11:55,327 DEBUG [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf 2023-07-19 13:11:55,327 INFO [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b94e00e035e2c4dda44cadecc5cec1b8 columnFamilyName cf 2023-07-19 13:11:55,363 DEBUG [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] regionserver.HStore(539): loaded hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/30fd491cf2c646a0a11a29af6dd50dac.517815623ded56829357f904dc8a1903->hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf/30fd491cf2c646a0a11a29af6dd50dac-top 2023-07-19 13:11:55,370 DEBUG [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] regionserver.HStore(539): loaded hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/86102157b276488ba3773335a8483b47.27da18df625b5c683dc845d7fe439bf2->hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf/86102157b276488ba3773335a8483b47-top 2023-07-19 13:11:55,370 INFO [StoreOpener-b94e00e035e2c4dda44cadecc5cec1b8-1] regionserver.HStore(310): Store=b94e00e035e2c4dda44cadecc5cec1b8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:11:55,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:11:55,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b94e00e035e2c4dda44cadecc5cec1b8; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59769680, jitterRate=-0.10936236381530762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:11:55,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b94e00e035e2c4dda44cadecc5cec1b8: 2023-07-19 13:11:55,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8., pid=77, masterSystemTime=1689772315294 2023-07-19 13:11:55,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.,because compaction is disabled. 2023-07-19 13:11:55,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:11:55,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:11:55,379 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=b94e00e035e2c4dda44cadecc5cec1b8, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:55,380 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772315379"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772315379"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772315379"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772315379"}]},"ts":"1689772315379"} 2023-07-19 13:11:55,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-19 13:11:55,383 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure b94e00e035e2c4dda44cadecc5cec1b8, server=jenkins-hbase4.apache.org,33135,1689772232949 in 239 msec 2023-07-19 13:11:55,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-19 13:11:55,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, ASSIGN in 404 msec 2023-07-19 13:11:55,387 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[517815623ded56829357f904dc8a1903, 27da18df625b5c683dc845d7fe439bf2], force=true in 1.3650 sec 2023-07-19 13:11:56,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-19 13:11:56,145 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-19 13:11:56,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 13:11:56,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772316146 (current time:1689772316146). 2023-07-19 13:11:56,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:11:56,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x6bdbb648 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:56,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b83b20d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:56,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:56,156 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:56,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bdbb648 to 127.0.0.1:64397 2023-07-19 13:11:56,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:56,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x7d465322 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:11:56,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c1002fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:11:56,168 DEBUG [hconnection-0x61ad427c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:11:56,171 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46918, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:11:56,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d465322 to 127.0.0.1:64397 2023-07-19 13:11:56,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:11:56,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-19 13:11:56,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:11:56,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 13:11:56,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 13:11:56,181 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 13:11:56,182 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689772916182 2023-07-19 13:11:56,182 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-19 13:11:56,186 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:11:56,186 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:11:56,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 13:11:56,187 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-19 13:11:56,189 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-19 13:11:56,190 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 13:11:56,190 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689772916190 2023-07-19 13:11:56,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,207 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-19 13:11:56,207 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:56,208 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-19 13:11:56,208 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-19 13:11:56,208 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,208 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,209 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:56,209 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:56,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:56,209 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,209 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:56,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:56,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:56,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:56,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:56,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:56,210 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,210 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:11:56,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-19 13:11:56,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 13:11:56,212 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 13:11:56,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,212 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:56,212 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-19 13:11:56,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 13:11:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 13:11:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 13:11:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:56,213 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 13:11:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 13:11:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 13:11:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 13:11:56,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-19 13:11:56,214 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:11:56,215 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-19 13:11:56,215 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-19 13:11:56,215 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-19 13:11:56,217 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,218 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,219 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,219 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,219 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:56,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:56,219 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,220 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:56,219 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:56,220 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:56,220 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:11:56,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:56,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:56,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-19 13:11:56,222 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d986b71[Count = 0] remaining members to acquire global barrier 2023-07-19 13:11:56,222 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-19 13:11:56,222 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,223 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,223 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,223 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 13:11:56,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,224 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:11:56,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,224 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 13:11:56,224 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:11:56,225 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:11:56,225 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:11:56,225 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:11:56,225 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 13:11:56,225 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. started... 2023-07-19 13:11:56,225 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:56,226 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 13:11:56,228 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 13:11:56,228 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b94e00e035e2c4dda44cadecc5cec1b8: 2023-07-19 13:11:56,228 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:56,228 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 13:11:56,231 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,231 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:11:56,231 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/30fd491cf2c646a0a11a29af6dd50dac.517815623ded56829357f904dc8a1903->hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf/30fd491cf2c646a0a11a29af6dd50dac-top, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/86102157b276488ba3773335a8483b47.27da18df625b5c683dc845d7fe439bf2->hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf/86102157b276488ba3773335a8483b47-top] hfiles 2023-07-19 13:11:56,231 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/30fd491cf2c646a0a11a29af6dd50dac.517815623ded56829357f904dc8a1903 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,232 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/86102157b276488ba3773335a8483b47.27da18df625b5c683dc845d7fe439bf2 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,287 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:56,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 13:11:56,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:56,288 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:11:56,323 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:11:56,488 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:56,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 13:11:56,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:11:56,490 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:11:56,644 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. completed. 2023-07-19 13:11:56,644 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:11:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:11:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:11:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-19 13:11:56,644 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:11:56,651 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,651 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-19 13:11:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:56,651 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:56,651 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-19 13:11:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:56,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:56,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:56,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:11:56,654 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-19 13:11:56,654 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-19 13:11:56,655 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:11:56,655 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:11:56,655 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,655 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:11:56,656 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,656 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,656 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:56,656 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,656 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:56,657 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:11:56,657 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:56,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,659 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,659 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,660 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:11:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,661 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,662 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,662 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,665 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,665 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:56,665 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:56,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:56,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:56,665 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:56,665 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:56,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:11:56,666 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,667 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:56,667 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,667 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,667 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:11:56,667 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:11:56,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:56,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:56,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:11:56,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:11:56,667 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:11:56,668 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:11:56,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:11:56,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,728 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-19 13:11:56,728 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,729 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,729 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689772316182Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772316667 (+485 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772316667Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772316671 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689772316687 (+16 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689772316728 (+41 ms) 2023-07-19 13:11:56,732 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-19 13:11:56,734 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 546 msec 2023-07-19 13:11:56,790 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:11:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-19 13:11:56,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:11:56,792 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792 2023-07-19 13:11:56,793 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42099, tgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792, rawTgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:56,827 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:11:56,827 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2055346015_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:56,827 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-19 13:11:56,845 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:11:57,345 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:57,345 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:57,346 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:57,346 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,406 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-9091059904098458761.jar 2023-07-19 13:11:58,406 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,406 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,489 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-843390247548842346.jar 2023-07-19 13:11:58,489 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,490 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,491 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,491 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,492 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:11:58,492 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:11:58,492 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:11:58,493 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:11:58,493 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:11:58,494 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:11:58,494 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:11:58,495 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:11:58,495 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:11:58,495 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:11:58,496 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:11:58,496 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:58,497 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:58,497 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:58,498 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:58,498 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:11:58,498 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:58,499 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:11:59,635 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:11:59,638 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-19 13:11:59,640 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-19 13:11:59,726 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:11:59,726 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:00,420 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:06,527 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:08,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:13,487 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:14,977 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:12:14,981 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:12:15,045 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,045 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:12:15,046 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:12:15,046 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 13:12:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 13:12:15,047 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,048 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-19 13:12:15,048 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772316792/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-19 13:12:15,060 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 13:12:15,066 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772335066"}]},"ts":"1689772335066"} 2023-07-19 13:12:15,068 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-19 13:12:15,069 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-19 13:12:15,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, UNASSIGN}] 2023-07-19 13:12:15,072 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, UNASSIGN 2023-07-19 13:12:15,073 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b94e00e035e2c4dda44cadecc5cec1b8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:15,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772335073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772335073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772335073"}]},"ts":"1689772335073"} 2023-07-19 13:12:15,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure b94e00e035e2c4dda44cadecc5cec1b8, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:12:15,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 13:12:15,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:12:15,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b94e00e035e2c4dda44cadecc5cec1b8, disabling compactions & flushes 2023-07-19 13:12:15,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:12:15,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:12:15,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. after waiting 0 ms 2023-07-19 13:12:15,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:12:15,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-19 13:12:15,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:15,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8. 2023-07-19 13:12:15,259 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b94e00e035e2c4dda44cadecc5cec1b8: 2023-07-19 13:12:15,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:12:15,262 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=b94e00e035e2c4dda44cadecc5cec1b8, regionState=CLOSED 2023-07-19 13:12:15,262 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689772335262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772335262"}]},"ts":"1689772335262"} 2023-07-19 13:12:15,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-19 13:12:15,266 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure b94e00e035e2c4dda44cadecc5cec1b8, server=jenkins-hbase4.apache.org,33135,1689772232949 in 189 msec 2023-07-19 13:12:15,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-19 13:12:15,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b94e00e035e2c4dda44cadecc5cec1b8, UNASSIGN in 196 msec 2023-07-19 13:12:15,269 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772335269"}]},"ts":"1689772335269"} 2023-07-19 13:12:15,271 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-19 13:12:15,276 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-19 13:12:15,279 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 217 msec 2023-07-19 13:12:15,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-19 13:12:15,368 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-19 13:12:15,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,376 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,379 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,384 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,384 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,385 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 13:12:15,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 13:12:15,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-19 13:12:15,388 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:12:15,390 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,391 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 2023-07-19 13:12:15,391 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:12:15,393 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,393 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-19 13:12:15,393 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,393 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,394 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,393 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:12:15,394 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,394 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:15,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:15,395 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:15,395 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/recovered.edits] 2023-07-19 13:12:15,396 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:15,396 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/recovered.edits] 2023-07-19 13:12:15,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 13:12:15,405 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf/86102157b276488ba3773335a8483b47 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/cf/86102157b276488ba3773335a8483b47 2023-07-19 13:12:15,415 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/recovered.edits/8.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2/recovered.edits/8.seqid 2023-07-19 13:12:15,416 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:12:15,417 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/recovered.edits] 2023-07-19 13:12:15,423 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/30fd491cf2c646a0a11a29af6dd50dac.517815623ded56829357f904dc8a1903 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/30fd491cf2c646a0a11a29af6dd50dac.517815623ded56829357f904dc8a1903 2023-07-19 13:12:15,427 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/86102157b276488ba3773335a8483b47.27da18df625b5c683dc845d7fe439bf2 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/cf/86102157b276488ba3773335a8483b47.27da18df625b5c683dc845d7fe439bf2 2023-07-19 13:12:15,434 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/recovered.edits/12.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8/recovered.edits/12.seqid 2023-07-19 13:12:15,434 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b94e00e035e2c4dda44cadecc5cec1b8 2023-07-19 13:12:15,436 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf/30fd491cf2c646a0a11a29af6dd50dac to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/cf/30fd491cf2c646a0a11a29af6dd50dac 2023-07-19 13:12:15,439 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/recovered.edits/8.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903/recovered.edits/8.seqid 2023-07-19 13:12:15,439 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/517815623ded56829357f904dc8a1903 2023-07-19 13:12:15,439 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-19 13:12:15,442 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,444 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-19 13:12:15,448 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-19 13:12:15,449 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,449 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-19 13:12:15,450 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772335450"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:15,451 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-19 13:12:15,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b94e00e035e2c4dda44cadecc5cec1b8, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689772313374.b94e00e035e2c4dda44cadecc5cec1b8.', STARTKEY => '', ENDKEY => ''}] 2023-07-19 13:12:15,452 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-19 13:12:15,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772335452"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:15,459 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-19 13:12:15,462 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:15,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 93 msec 2023-07-19 13:12:15,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-19 13:12:15,502 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-19 13:12:15,502 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:15,511 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772335511"}]},"ts":"1689772335511"} 2023-07-19 13:12:15,514 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-19 13:12:15,516 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-19 13:12:15,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, UNASSIGN}] 2023-07-19 13:12:15,519 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, UNASSIGN 2023-07-19 13:12:15,521 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, UNASSIGN 2023-07-19 13:12:15,522 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=443c2fc178e374cadae14ce28a052932, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:15,522 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772335522"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772335522"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772335522"}]},"ts":"1689772335522"} 2023-07-19 13:12:15,523 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=744c18afa44fa7ed60ee6b5c04d3a5e1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:15,523 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772335523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772335523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772335523"}]},"ts":"1689772335523"} 2023-07-19 13:12:15,526 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 443c2fc178e374cadae14ce28a052932, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:12:15,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure 744c18afa44fa7ed60ee6b5c04d3a5e1, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:12:15,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:15,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 443c2fc178e374cadae14ce28a052932 2023-07-19 13:12:15,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 443c2fc178e374cadae14ce28a052932, disabling compactions & flushes 2023-07-19 13:12:15,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:12:15,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:12:15,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. after waiting 0 ms 2023-07-19 13:12:15,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:12:15,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:12:15,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 744c18afa44fa7ed60ee6b5c04d3a5e1, disabling compactions & flushes 2023-07-19 13:12:15,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:12:15,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:12:15,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. after waiting 0 ms 2023-07-19 13:12:15,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:12:15,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:15,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:15,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932. 2023-07-19 13:12:15,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 443c2fc178e374cadae14ce28a052932: 2023-07-19 13:12:15,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 443c2fc178e374cadae14ce28a052932 2023-07-19 13:12:15,708 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=443c2fc178e374cadae14ce28a052932, regionState=CLOSED 2023-07-19 13:12:15,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:15,708 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772335708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772335708"}]},"ts":"1689772335708"} 2023-07-19 13:12:15,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:15,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1. 2023-07-19 13:12:15,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 744c18afa44fa7ed60ee6b5c04d3a5e1: 2023-07-19 13:12:15,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:12:15,713 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=744c18afa44fa7ed60ee6b5c04d3a5e1, regionState=CLOSED 2023-07-19 13:12:15,713 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689772335713"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772335713"}]},"ts":"1689772335713"} 2023-07-19 13:12:15,714 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-19 13:12:15,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 443c2fc178e374cadae14ce28a052932, server=jenkins-hbase4.apache.org,39417,1689772232852 in 186 msec 2023-07-19 13:12:15,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=443c2fc178e374cadae14ce28a052932, UNASSIGN in 197 msec 2023-07-19 13:12:15,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-19 13:12:15,725 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure 744c18afa44fa7ed60ee6b5c04d3a5e1, server=jenkins-hbase4.apache.org,34931,1689772233028 in 195 msec 2023-07-19 13:12:15,727 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-19 13:12:15,728 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=744c18afa44fa7ed60ee6b5c04d3a5e1, UNASSIGN in 208 msec 2023-07-19 13:12:15,728 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772335728"}]},"ts":"1689772335728"} 2023-07-19 13:12:15,731 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-19 13:12:15,736 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-19 13:12:15,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 234 msec 2023-07-19 13:12:15,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-19 13:12:15,815 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-19 13:12:15,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,821 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,822 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,823 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,827 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,827 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,827 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,827 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:15,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:15,828 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-19 13:12:15,828 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:12:15,828 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 2023-07-19 13:12:15,829 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,833 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/recovered.edits] 2023-07-19 13:12:15,833 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/recovered.edits] 2023-07-19 13:12:15,834 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,834 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,834 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-19 13:12:15,834 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:12:15,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 13:12:15,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,837 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:15,841 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf/203a853c2af94f0ca56c9e3de1f3d39d to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/cf/203a853c2af94f0ca56c9e3de1f3d39d 2023-07-19 13:12:15,841 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf/5234e33b656f451aa99e60daf386e9ee to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/cf/5234e33b656f451aa99e60daf386e9ee 2023-07-19 13:12:15,845 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932/recovered.edits/9.seqid 2023-07-19 13:12:15,845 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1/recovered.edits/9.seqid 2023-07-19 13:12:15,846 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/443c2fc178e374cadae14ce28a052932 2023-07-19 13:12:15,846 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/744c18afa44fa7ed60ee6b5c04d3a5e1 2023-07-19 13:12:15,846 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-19 13:12:15,850 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,857 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-19 13:12:15,864 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-19 13:12:15,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,873 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-19 13:12:15,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772335873"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:15,874 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772335873"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:15,876 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:12:15,876 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 744c18afa44fa7ed60ee6b5c04d3a5e1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689772311053.744c18afa44fa7ed60ee6b5c04d3a5e1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 443c2fc178e374cadae14ce28a052932, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689772311053.443c2fc178e374cadae14ce28a052932.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:12:15,876 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-19 13:12:15,877 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772335876"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:15,878 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-19 13:12:15,881 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,882 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 64 msec 2023-07-19 13:12:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-19 13:12:15,938 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-19 13:12:15,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 13:12:15,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-19 13:12:15,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-19 13:12:15,981 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-19 13:12:15,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-19 13:12:16,021 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 748) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:53454 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-983447671_1 at /127.0.0.1:34834 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-983447671_1 at /127.0.0.1:58480 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:44767 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3947 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:34838 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:58504 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=915 (was 898) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=490 (was 344) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 188), AvailableMemoryMB=2267 (was 2880) 2023-07-19 13:12:16,021 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-19 13:12:16,049 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=915, MaxFileDescriptor=60000, SystemLoadAverage=490, ProcessCount=185, AvailableMemoryMB=2264 2023-07-19 13:12:16,050 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-19 13:12:16,054 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:12:16,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:16,061 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:12:16,062 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-19 13:12:16,062 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:12:16,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:16,065 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,065 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,065 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 empty. 2023-07-19 13:12:16,065 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 empty. 2023-07-19 13:12:16,066 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,066 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,066 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 13:12:16,087 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-19 13:12:16,089 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 80b412245d5c24e0ad947a5a74d1ba46, NAME => 'testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:12:16,089 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 25727391a38486782504a5b84d5f5ea6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:12:16,108 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:16,108 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 80b412245d5c24e0ad947a5a74d1ba46, disabling compactions & flushes 2023-07-19 13:12:16,108 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,108 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,108 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. after waiting 0 ms 2023-07-19 13:12:16,108 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,108 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,108 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 80b412245d5c24e0ad947a5a74d1ba46: 2023-07-19 13:12:16,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:16,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 25727391a38486782504a5b84d5f5ea6, disabling compactions & flushes 2023-07-19 13:12:16,113 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,113 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. after waiting 0 ms 2023-07-19 13:12:16,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,114 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,114 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 25727391a38486782504a5b84d5f5ea6: 2023-07-19 13:12:16,116 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:12:16,117 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772336117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772336117"}]},"ts":"1689772336117"} 2023-07-19 13:12:16,117 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772336117"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772336117"}]},"ts":"1689772336117"} 2023-07-19 13:12:16,119 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:12:16,120 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:12:16,120 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772336120"}]},"ts":"1689772336120"} 2023-07-19 13:12:16,121 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-19 13:12:16,135 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:12:16,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:12:16,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:12:16,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:12:16,137 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:12:16,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, ASSIGN}] 2023-07-19 13:12:16,142 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, ASSIGN 2023-07-19 13:12:16,142 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, ASSIGN 2023-07-19 13:12:16,142 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39417,1689772232852; forceNewPlan=false, retain=false 2023-07-19 13:12:16,142 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34931,1689772233028; forceNewPlan=false, retain=false 2023-07-19 13:12:16,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:16,292 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:12:16,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=80b412245d5c24e0ad947a5a74d1ba46, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,295 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=25727391a38486782504a5b84d5f5ea6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,295 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772336295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772336295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772336295"}]},"ts":"1689772336295"} 2023-07-19 13:12:16,295 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772336295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772336295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772336295"}]},"ts":"1689772336295"} 2023-07-19 13:12:16,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 80b412245d5c24e0ad947a5a74d1ba46, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:12:16,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 25727391a38486782504a5b84d5f5ea6, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:12:16,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:16,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 25727391a38486782504a5b84d5f5ea6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:12:16,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 80b412245d5c24e0ad947a5a74d1ba46, NAME => 'testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:12:16,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. service=AccessControlService 2023-07-19 13:12:16,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. service=AccessControlService 2023-07-19 13:12:16,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:16,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:16,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,455 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,458 INFO [StoreOpener-25727391a38486782504a5b84d5f5ea6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,458 INFO [StoreOpener-80b412245d5c24e0ad947a5a74d1ba46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,461 DEBUG [StoreOpener-25727391a38486782504a5b84d5f5ea6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf 2023-07-19 13:12:16,461 DEBUG [StoreOpener-25727391a38486782504a5b84d5f5ea6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf 2023-07-19 13:12:16,461 DEBUG [StoreOpener-80b412245d5c24e0ad947a5a74d1ba46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf 2023-07-19 13:12:16,461 DEBUG [StoreOpener-80b412245d5c24e0ad947a5a74d1ba46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf 2023-07-19 13:12:16,461 INFO [StoreOpener-25727391a38486782504a5b84d5f5ea6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 25727391a38486782504a5b84d5f5ea6 columnFamilyName cf 2023-07-19 13:12:16,461 INFO [StoreOpener-80b412245d5c24e0ad947a5a74d1ba46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 80b412245d5c24e0ad947a5a74d1ba46 columnFamilyName cf 2023-07-19 13:12:16,462 INFO [StoreOpener-25727391a38486782504a5b84d5f5ea6-1] regionserver.HStore(310): Store=25727391a38486782504a5b84d5f5ea6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:16,462 INFO [StoreOpener-80b412245d5c24e0ad947a5a74d1ba46-1] regionserver.HStore(310): Store=80b412245d5c24e0ad947a5a74d1ba46/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:16,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:16,469 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 80b412245d5c24e0ad947a5a74d1ba46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66260408, jitterRate=-0.012642979621887207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:16,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 80b412245d5c24e0ad947a5a74d1ba46: 2023-07-19 13:12:16,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:16,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 25727391a38486782504a5b84d5f5ea6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62936888, jitterRate=-0.06216728687286377}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:16,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 25727391a38486782504a5b84d5f5ea6: 2023-07-19 13:12:16,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46., pid=93, masterSystemTime=1689772336449 2023-07-19 13:12:16,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6., pid=94, masterSystemTime=1689772336450 2023-07-19 13:12:16,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,479 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=25727391a38486782504a5b84d5f5ea6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,479 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772336479"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772336479"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772336479"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772336479"}]},"ts":"1689772336479"} 2023-07-19 13:12:16,480 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=80b412245d5c24e0ad947a5a74d1ba46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,480 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772336480"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772336480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772336480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772336480"}]},"ts":"1689772336480"} 2023-07-19 13:12:16,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-19 13:12:16,485 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 25727391a38486782504a5b84d5f5ea6, server=jenkins-hbase4.apache.org,39417,1689772232852 in 185 msec 2023-07-19 13:12:16,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-19 13:12:16,487 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 80b412245d5c24e0ad947a5a74d1ba46, server=jenkins-hbase4.apache.org,34931,1689772233028 in 187 msec 2023-07-19 13:12:16,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, ASSIGN in 349 msec 2023-07-19 13:12:16,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-19 13:12:16,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, ASSIGN in 350 msec 2023-07-19 13:12:16,490 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:12:16,491 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772336490"}]},"ts":"1689772336490"} 2023-07-19 13:12:16,492 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-19 13:12:16,494 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:12:16,495 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-19 13:12:16,496 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:12:16,498 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:16,498 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:16,498 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:16,498 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:16,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:16,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:16,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:16,500 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:16,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 446 msec 2023-07-19 13:12:16,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-19 13:12:16,667 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-19 13:12:16,667 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-19 13:12:16,668 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:16,672 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-19 13:12:16,673 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:16,673 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-19 13:12:16,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:16,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772336676 (current time:1689772336676). 2023-07-19 13:12:16,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:16,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x067d1610 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:16,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@271b44a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:16,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:16,694 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53480, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:16,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x067d1610 to 127.0.0.1:64397 2023-07-19 13:12:16,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:16,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x17d8ffad to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:16,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79fbb6d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:16,703 DEBUG [hconnection-0x4b8fb34-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:16,704 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:16,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17d8ffad to 127.0.0.1:64397 2023-07-19 13:12:16,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:16,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:12:16,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:16,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:16,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:16,713 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:16,714 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772936714 2023-07-19 13:12:16,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:16,715 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:16,716 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:16,716 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:16,718 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:16,720 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:16,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-19 13:12:16,723 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:16,724 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772936724 2023-07-19 13:12:16,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,738 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-19 13:12:16,738 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:16,740 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 13:12:16,740 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:12:16,740 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,740 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,745 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:16,745 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:16,745 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:16,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:16,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:16,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:16,745 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:16,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,746 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,746 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 13:12:16,747 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,747 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:16,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,748 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:16,748 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:16,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,749 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:16,749 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:16,751 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:16,752 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:16,754 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,754 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:16,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:16,755 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,756 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:16,756 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:16,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ed4f95f[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:16,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:16,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:16,761 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ed4f95f[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:16,761 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:12:16,761 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,762 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,762 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,762 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,763 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,763 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:16,763 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,763 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:16,763 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:16,763 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:16,763 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:16,763 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:12:16,766 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:16,766 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:16,767 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,767 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. started... 2023-07-19 13:12:16,768 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:16,768 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:16,768 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:16,772 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25727391a38486782504a5b84d5f5ea6: 2023-07-19 13:12:16,772 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,772 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:16,772 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:16,779 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:16,780 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:16,781 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,781 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. started... 2023-07-19 13:12:16,783 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80b412245d5c24e0ad947a5a74d1ba46: 2023-07-19 13:12:16,788 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,789 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:16,789 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:16,816 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:16,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:16,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:16,818 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:16,819 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. completed. 2023-07-19 13:12:16,819 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:16,819 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:16,819 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:16,819 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,819 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:16,819 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:12:16,821 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,821 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:16,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:16,821 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:16,821 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:12:16,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:12:16,844 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. completed. 2023-07-19 13:12:16,844 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:16,844 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:16,844 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:16,844 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,844 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:16,845 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:12:16,846 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:16,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:16,847 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:16,847 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:16,847 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:16,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:16,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34931,1689772233028': 2023-07-19 13:12:16,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:12:16,853 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 13:12:16,853 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:16,853 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:16,853 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,853 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:16,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:16,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,855 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:16,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:16,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,856 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,857 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:16,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:16,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:16,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:16,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:16,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:16,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:16,858 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,859 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:16,859 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:16,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,861 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,862 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,862 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,866 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:16,866 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:16,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:16,866 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:16,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:16,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:16,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:16,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:16,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,869 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:16,869 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:16,869 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,869 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,869 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:16,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,869 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:16,869 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:16,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:16,871 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:16,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:16,871 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:16,872 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 13:12:16,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,923 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:16,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689772336715Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689772336869 (+154 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689772336869Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689772336877 (+8 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689772336886 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689772336923 (+37 ms) 2023-07-19 13:12:16,926 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:16,929 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 211 msec 2023-07-19 13:12:17,018 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:17,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:17,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:17,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34931] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:17,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:17,040 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:17,040 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:17,041 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:17,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:17,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772337053 (current time:1689772337053). 2023-07-19 13:12:17,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:17,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x4af95c22 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:17,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@95b7f12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:17,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:17,065 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53500, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:17,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4af95c22 to 127.0.0.1:64397 2023-07-19 13:12:17,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:17,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x747ca2b0 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:17,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7464e851, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:17,081 DEBUG [hconnection-0x2615ba20-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:17,084 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:17,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x747ca2b0 to 127.0.0.1:64397 2023-07-19 13:12:17,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:17,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-19 13:12:17,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:17,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:17,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:17,096 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:17,098 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689772937098 2023-07-19 13:12:17,098 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:17,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-19 13:12:17,099 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:17,100 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:17,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:17,104 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-19 13:12:17,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-19 13:12:17,106 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:17,107 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689772937107 2023-07-19 13:12:17,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,131 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-19 13:12:17,131 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:17,132 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-19 13:12:17,133 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-19 13:12:17,133 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,133 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,134 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:17,134 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:17,134 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:17,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:17,134 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:17,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:17,135 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,135 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,135 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,135 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:17,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-19 13:12:17,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,139 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:17,139 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:17,139 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:17,139 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:17,142 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,143 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:17,144 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-19 13:12:17,144 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:17,143 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:17,149 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-19 13:12:17,149 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:17,144 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:17,149 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:17,149 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-19 13:12:17,149 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:17,149 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-19 13:12:17,151 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,151 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,151 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:17,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:17,151 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,152 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,152 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,152 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:17,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:17,152 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,152 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:17,153 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,153 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:17,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:17,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343c360[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:17,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:17,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-19 13:12:17,157 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5343c360[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:17,157 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-19 13:12:17,157 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:17,163 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:17,163 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:12:17,163 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,163 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:17,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,163 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-19 13:12:17,163 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,163 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:17,164 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:17,164 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:17,164 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:17,168 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:17,168 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:17,168 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:17,170 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:17,170 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:17,170 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:17,170 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. started... 2023-07-19 13:12:17,170 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. started... 2023-07-19 13:12:17,170 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 80b412245d5c24e0ad947a5a74d1ba46 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-19 13:12:17,170 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 25727391a38486782504a5b84d5f5ea6 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-19 13:12:17,191 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/.tmp/cf/91fbe3f6e0134de48f2921c60ccd3c60 2023-07-19 13:12:17,197 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/.tmp/cf/641929b6030d411c92f8d7ffdf828fdf 2023-07-19 13:12:17,200 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:17,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:17,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:17,201 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:17,204 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/.tmp/cf/91fbe3f6e0134de48f2921c60ccd3c60 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf/91fbe3f6e0134de48f2921c60ccd3c60 2023-07-19 13:12:17,204 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/.tmp/cf/641929b6030d411c92f8d7ffdf828fdf as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf/641929b6030d411c92f8d7ffdf828fdf 2023-07-19 13:12:17,210 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf/641929b6030d411c92f8d7ffdf828fdf, entries=3, sequenceid=6, filesize=5.0 K 2023-07-19 13:12:17,211 INFO [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 80b412245d5c24e0ad947a5a74d1ba46 in 41ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:17,211 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-19 13:12:17,212 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 80b412245d5c24e0ad947a5a74d1ba46: 2023-07-19 13:12:17,212 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,212 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:17,212 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf/641929b6030d411c92f8d7ffdf828fdf] hfiles 2023-07-19 13:12:17,212 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf/641929b6030d411c92f8d7ffdf828fdf for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,219 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf/91fbe3f6e0134de48f2921c60ccd3c60, entries=47, sequenceid=6, filesize=8.0 K 2023-07-19 13:12:17,220 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 25727391a38486782504a5b84d5f5ea6 in 50ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:17,226 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 25727391a38486782504a5b84d5f5ea6: 2023-07-19 13:12:17,226 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,226 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:17,226 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf/91fbe3f6e0134de48f2921c60ccd3c60] hfiles 2023-07-19 13:12:17,226 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf/91fbe3f6e0134de48f2921c60ccd3c60 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,230 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. completed. 2023-07-19 13:12:17,230 DEBUG [rs(jenkins-hbase4.apache.org,34931,1689772233028)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:17,230 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:17,230 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:17,230 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,230 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:17,230 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:12:17,232 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,232 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:17,232 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:17,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:17,232 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:17,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:17,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,237 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. completed. 2023-07-19 13:12:17,237 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:17,237 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:17,237 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:17,237 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,237 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-19 13:12:17,237 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:12:17,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:17,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,239 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,239 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-19 13:12:17,239 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:17,239 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-19 13:12:17,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34931,1689772233028': 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:17,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:17,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:12:17,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-19 13:12:17,247 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-19 13:12:17,247 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:17,247 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:17,248 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,248 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:17,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:17,251 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:17,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:17,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:17,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:17,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,253 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:17,253 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,254 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,255 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:17,256 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,256 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,258 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:17,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:17,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:17,259 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:17,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:17,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,259 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:17,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:17,261 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:17,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:17,262 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:17,261 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:17,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:17,262 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:17,262 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:17,262 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,262 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:17,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:17,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-19 13:12:17,322 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,323 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689772337098Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689772337261 (+163 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689772337262 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689772337274 (+12 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689772337287 (+13 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689772337322 (+35 ms) 2023-07-19 13:12:17,326 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-19 13:12:17,327 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 227 msec 2023-07-19 13:12:17,401 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:17,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-19 13:12:17,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:17,403 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403 2023-07-19 13:12:17,403 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42099, tgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403, rawTgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:12:17,461 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:12:17,462 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1914550614_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,462 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-19 13:12:17,467 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:17,495 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:17,496 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:17,496 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:17,496 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,519 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-7146345750277693575.jar 2023-07-19 13:12:18,519 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,519 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,589 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-1753231144360033179.jar 2023-07-19 13:12:18,590 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,590 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,590 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,591 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,591 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,591 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:18,592 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:12:18,592 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:12:18,592 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:12:18,593 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:12:18,593 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:12:18,594 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:12:18,594 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:12:18,595 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:12:18,595 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:12:18,596 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:12:18,596 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:18,597 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:18,597 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:18,598 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:18,598 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:18,599 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:18,599 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:19,647 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0005_000001 (auth:SIMPLE) 2023-07-19 13:12:19,775 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:12:19,783 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-19 13:12:20,344 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:20,344 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:20,642 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0006_000001 (auth:SIMPLE) 2023-07-19 13:12:20,889 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:12:26,273 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0006_000001 (auth:SIMPLE) 2023-07-19 13:12:28,696 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:12:28,698 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:12:28,731 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:28,731 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:12:28,732 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:12:28,732 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:28,733 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 13:12:28,733 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 13:12:28,733 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:28,733 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-19 13:12:28,733 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772337403/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-19 13:12:28,741 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-19 13:12:28,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-19 13:12:28,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:28,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 13:12:28,752 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772348752"}]},"ts":"1689772348752"} 2023-07-19 13:12:28,754 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-19 13:12:28,762 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-19 13:12:28,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, UNASSIGN}] 2023-07-19 13:12:28,769 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, UNASSIGN 2023-07-19 13:12:28,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, UNASSIGN 2023-07-19 13:12:28,771 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=80b412245d5c24e0ad947a5a74d1ba46, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:28,771 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=25727391a38486782504a5b84d5f5ea6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:28,771 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772348770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772348770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772348770"}]},"ts":"1689772348770"} 2023-07-19 13:12:28,771 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772348770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772348770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772348770"}]},"ts":"1689772348770"} 2023-07-19 13:12:28,775 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 80b412245d5c24e0ad947a5a74d1ba46, server=jenkins-hbase4.apache.org,34931,1689772233028}] 2023-07-19 13:12:28,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 25727391a38486782504a5b84d5f5ea6, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:12:28,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 13:12:28,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:28,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 80b412245d5c24e0ad947a5a74d1ba46, disabling compactions & flushes 2023-07-19 13:12:28,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:28,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:28,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. after waiting 0 ms 2023-07-19 13:12:28,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:28,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:28,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 25727391a38486782504a5b84d5f5ea6, disabling compactions & flushes 2023-07-19 13:12:28,937 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:28,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:28,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. after waiting 0 ms 2023-07-19 13:12:28,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:28,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:28,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:28,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:28,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46. 2023-07-19 13:12:28,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 80b412245d5c24e0ad947a5a74d1ba46: 2023-07-19 13:12:28,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:28,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6. 2023-07-19 13:12:28,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 25727391a38486782504a5b84d5f5ea6: 2023-07-19 13:12:28,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:28,950 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=80b412245d5c24e0ad947a5a74d1ba46, regionState=CLOSED 2023-07-19 13:12:28,950 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772348949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772348949"}]},"ts":"1689772348949"} 2023-07-19 13:12:28,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:28,950 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=25727391a38486782504a5b84d5f5ea6, regionState=CLOSED 2023-07-19 13:12:28,950 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689772348950"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772348950"}]},"ts":"1689772348950"} 2023-07-19 13:12:28,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-19 13:12:28,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 80b412245d5c24e0ad947a5a74d1ba46, server=jenkins-hbase4.apache.org,34931,1689772233028 in 178 msec 2023-07-19 13:12:28,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-19 13:12:28,954 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 25727391a38486782504a5b84d5f5ea6, server=jenkins-hbase4.apache.org,39417,1689772232852 in 176 msec 2023-07-19 13:12:28,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=80b412245d5c24e0ad947a5a74d1ba46, UNASSIGN in 190 msec 2023-07-19 13:12:28,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-19 13:12:28,956 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=25727391a38486782504a5b84d5f5ea6, UNASSIGN in 191 msec 2023-07-19 13:12:28,957 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772348957"}]},"ts":"1689772348957"} 2023-07-19 13:12:28,958 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-19 13:12:28,960 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-19 13:12:28,962 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 219 msec 2023-07-19 13:12:29,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-19 13:12:29,054 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-19 13:12:29,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,062 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,063 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,065 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,069 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:29,069 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:29,073 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/recovered.edits] 2023-07-19 13:12:29,073 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,073 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,073 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,073 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,073 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/recovered.edits] 2023-07-19 13:12:29,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:29,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:29,074 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-19 13:12:29,075 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,075 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,075 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,075 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,075 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,075 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-19 13:12:29,075 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-19 13:12:29,075 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,076 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 13:12:29,081 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf/91fbe3f6e0134de48f2921c60ccd3c60 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/cf/91fbe3f6e0134de48f2921c60ccd3c60 2023-07-19 13:12:29,082 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf/641929b6030d411c92f8d7ffdf828fdf to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/cf/641929b6030d411c92f8d7ffdf828fdf 2023-07-19 13:12:29,085 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6/recovered.edits/9.seqid 2023-07-19 13:12:29,086 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46/recovered.edits/9.seqid 2023-07-19 13:12:29,086 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/25727391a38486782504a5b84d5f5ea6 2023-07-19 13:12:29,087 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testEmptyExportFileSystemState/80b412245d5c24e0ad947a5a74d1ba46 2023-07-19 13:12:29,087 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-19 13:12:29,089 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,092 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-19 13:12:29,094 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-19 13:12:29,096 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,096 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-19 13:12:29,096 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772349096"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:29,096 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772349096"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:29,100 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:12:29,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 80b412245d5c24e0ad947a5a74d1ba46, NAME => 'testtb-testEmptyExportFileSystemState,,1689772336053.80b412245d5c24e0ad947a5a74d1ba46.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 25727391a38486782504a5b84d5f5ea6, NAME => 'testtb-testEmptyExportFileSystemState,1,1689772336053.25727391a38486782504a5b84d5f5ea6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:12:29,101 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-19 13:12:29,101 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772349101"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:29,103 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-19 13:12:29,105 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-19 13:12:29,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 50 msec 2023-07-19 13:12:29,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-19 13:12:29,181 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-19 13:12:29,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-19 13:12:29,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:29,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-19 13:12:29,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-19 13:12:29,234 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:42455 from appattempt_1689772241838_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4082387e-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_735998076_17 at /127.0.0.1:52454 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:37100 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4720 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:42455 from appattempt_1689772241838_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_414818060_17 at /127.0.0.1:45816 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_613439574_1 at /127.0.0.1:37076 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (857873035) connection to jenkins-hbase4.apache.org/172.31.14.131:41099 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_613439574_1 at /127.0.0.1:52420 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4082387e-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 915) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=538 (was 490) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1922 (was 2264) 2023-07-19 13:12:29,235 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-19 13:12:29,265 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=916, MaxFileDescriptor=60000, SystemLoadAverage=538, ProcessCount=185, AvailableMemoryMB=1911 2023-07-19 13:12:29,265 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-19 13:12:29,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-19 13:12:29,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:29,271 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-19 13:12:29,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-19 13:12:29,272 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-19 13:12:29,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:29,275 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,276 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,276 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b empty. 2023-07-19 13:12:29,277 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 empty. 2023-07-19 13:12:29,277 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,277 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,278 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 13:12:29,319 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-19 13:12:29,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 27c2cec8b5323d746b63c957209746b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:12:29,322 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c19883129de4f6d34cd6a9577e04774b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp 2023-07-19 13:12:29,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:29,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 27c2cec8b5323d746b63c957209746b4, disabling compactions & flushes 2023-07-19 13:12:29,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. after waiting 0 ms 2023-07-19 13:12:29,367 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,367 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,368 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 27c2cec8b5323d746b63c957209746b4: 2023-07-19 13:12:29,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:29,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:29,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c19883129de4f6d34cd6a9577e04774b, disabling compactions & flushes 2023-07-19 13:12:29,376 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. after waiting 0 ms 2023-07-19 13:12:29,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,376 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,376 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c19883129de4f6d34cd6a9577e04774b: 2023-07-19 13:12:29,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-19 13:12:29,383 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772349382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772349382"}]},"ts":"1689772349382"} 2023-07-19 13:12:29,383 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772349382"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772349382"}]},"ts":"1689772349382"} 2023-07-19 13:12:29,385 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-19 13:12:29,386 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-19 13:12:29,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772349386"}]},"ts":"1689772349386"} 2023-07-19 13:12:29,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-19 13:12:29,392 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-19 13:12:29,393 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-19 13:12:29,394 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-19 13:12:29,394 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-19 13:12:29,394 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-19 13:12:29,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, ASSIGN}] 2023-07-19 13:12:29,397 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, ASSIGN 2023-07-19 13:12:29,398 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, ASSIGN 2023-07-19 13:12:29,399 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33135,1689772232949; forceNewPlan=false, retain=false 2023-07-19 13:12:29,400 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39417,1689772232852; forceNewPlan=false, retain=false 2023-07-19 13:12:29,550 INFO [jenkins-hbase4:43411] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-19 13:12:29,553 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=27c2cec8b5323d746b63c957209746b4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:29,553 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c19883129de4f6d34cd6a9577e04774b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:29,553 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772349553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772349553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772349553"}]},"ts":"1689772349553"} 2023-07-19 13:12:29,553 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772349553"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772349553"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772349553"}]},"ts":"1689772349553"} 2023-07-19 13:12:29,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 27c2cec8b5323d746b63c957209746b4, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:12:29,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c19883129de4f6d34cd6a9577e04774b, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:12:29,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:29,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27c2cec8b5323d746b63c957209746b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.', STARTKEY => '1', ENDKEY => ''} 2023-07-19 13:12:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. service=AccessControlService 2023-07-19 13:12:29,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,734 INFO [StoreOpener-27c2cec8b5323d746b63c957209746b4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,735 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c19883129de4f6d34cd6a9577e04774b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.', STARTKEY => '', ENDKEY => '1'} 2023-07-19 13:12:29,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. service=AccessControlService 2023-07-19 13:12:29,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-19 13:12:29,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,736 DEBUG [StoreOpener-27c2cec8b5323d746b63c957209746b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf 2023-07-19 13:12:29,736 DEBUG [StoreOpener-27c2cec8b5323d746b63c957209746b4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf 2023-07-19 13:12:29,736 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-19 13:12:29,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,737 INFO [StoreOpener-27c2cec8b5323d746b63c957209746b4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27c2cec8b5323d746b63c957209746b4 columnFamilyName cf 2023-07-19 13:12:29,738 INFO [StoreOpener-27c2cec8b5323d746b63c957209746b4-1] regionserver.HStore(310): Store=27c2cec8b5323d746b63c957209746b4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:29,738 INFO [StoreOpener-c19883129de4f6d34cd6a9577e04774b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,750 DEBUG [StoreOpener-c19883129de4f6d34cd6a9577e04774b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf 2023-07-19 13:12:29,751 DEBUG [StoreOpener-c19883129de4f6d34cd6a9577e04774b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf 2023-07-19 13:12:29,751 INFO [StoreOpener-c19883129de4f6d34cd6a9577e04774b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c19883129de4f6d34cd6a9577e04774b columnFamilyName cf 2023-07-19 13:12:29,752 INFO [StoreOpener-c19883129de4f6d34cd6a9577e04774b-1] regionserver.HStore(310): Store=c19883129de4f6d34cd6a9577e04774b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-19 13:12:29,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:29,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:29,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:29,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27c2cec8b5323d746b63c957209746b4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71286704, jitterRate=0.06225466728210449}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:29,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-19 13:12:29,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27c2cec8b5323d746b63c957209746b4: 2023-07-19 13:12:29,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c19883129de4f6d34cd6a9577e04774b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71428452, jitterRate=0.06436687707901001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-19 13:12:29,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c19883129de4f6d34cd6a9577e04774b: 2023-07-19 13:12:29,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4., pid=108, masterSystemTime=1689772349707 2023-07-19 13:12:29,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b., pid=109, masterSystemTime=1689772349708 2023-07-19 13:12:29,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:29,767 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=27c2cec8b5323d746b63c957209746b4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:29,767 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772349767"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772349767"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772349767"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772349767"}]},"ts":"1689772349767"} 2023-07-19 13:12:29,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:29,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c19883129de4f6d34cd6a9577e04774b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:29,768 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772349768"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689772349768"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689772349768"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689772349768"}]},"ts":"1689772349768"} 2023-07-19 13:12:29,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-19 13:12:29,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 27c2cec8b5323d746b63c957209746b4, server=jenkins-hbase4.apache.org,39417,1689772232852 in 216 msec 2023-07-19 13:12:29,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-19 13:12:29,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c19883129de4f6d34cd6a9577e04774b, server=jenkins-hbase4.apache.org,33135,1689772232949 in 218 msec 2023-07-19 13:12:29,779 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, ASSIGN in 383 msec 2023-07-19 13:12:29,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-19 13:12:29,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, ASSIGN in 385 msec 2023-07-19 13:12:29,785 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-19 13:12:29,785 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772349785"}]},"ts":"1689772349785"} 2023-07-19 13:12:29,787 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-19 13:12:29,790 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-19 13:12:29,790 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-19 13:12:29,792 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 13:12:29,797 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,797 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,797 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,797 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:29,799 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:29,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:29,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:29,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:29,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-19 13:12:29,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 531 msec 2023-07-19 13:12:29,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-19 13:12:29,878 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-19 13:12:29,879 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-19 13:12:29,879 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:29,882 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-19 13:12:29,882 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:29,882 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-19 13:12:29,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:29,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772349885 (current time:1689772349885). 2023-07-19 13:12:29,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:29,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x049d29ac to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:29,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@472a8d38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:29,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:29,919 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:29,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x049d29ac to 127.0.0.1:64397 2023-07-19 13:12:29,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:29,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x5e4ce024 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:29,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33716208, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:30,026 DEBUG [hconnection-0x20a16a13-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:30,030 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:30,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e4ce024 to 127.0.0.1:64397 2023-07-19 13:12:30,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:30,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 13:12:30,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:30,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:30,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:30,042 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:30,043 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689772950043 2023-07-19 13:12:30,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:30,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,044 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:30,044 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:30,047 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:30,048 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:30,049 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-19 13:12:30,050 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:30,051 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689772950051 2023-07-19 13:12:30,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,117 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 13:12:30,118 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,119 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 13:12:30,119 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 13:12:30,120 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,120 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,122 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,122 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,122 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,122 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,123 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,123 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,123 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,123 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,124 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:30,127 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,127 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:30,127 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,130 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:30,130 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,130 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:30,136 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:30,138 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:30,144 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:30,145 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,145 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,145 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,145 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,145 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:30,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:30,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:30,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,146 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:30,147 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350b150e[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:30,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@350b150e[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:30,154 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 13:12:30,154 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,155 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:12:30,156 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,156 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:30,156 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:30,157 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. started... 2023-07-19 13:12:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:30,157 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:30,159 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. started... 2023-07-19 13:12:30,159 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27c2cec8b5323d746b63c957209746b4: 2023-07-19 13:12:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c19883129de4f6d34cd6a9577e04774b: 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,161 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:30,161 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-19 13:12:30,240 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. completed. 2023-07-19 13:12:30,240 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:30,240 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:30,240 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:30,240 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,241 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:30,241 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:12:30,242 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. completed. 2023-07-19 13:12:30,242 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:30,242 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:30,243 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:30,243 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,243 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:30,243 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:12:30,245 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,245 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:30,245 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:30,245 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:30,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,248 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:30,249 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:30,249 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,249 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:12:30,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 13:12:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:12:30,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 13:12:30,265 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 13:12:30,265 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:30,265 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:30,265 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,265 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:30,270 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,270 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:30,270 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:30,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:30,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,271 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:30,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:30,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,273 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,274 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,274 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,278 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,278 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,279 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,284 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,284 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:30,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,284 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,284 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:30,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,285 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:30,285 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,287 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:30,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:30,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:30,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:30,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,351 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:30,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:30,352 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:12:30,399 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 13:12:30,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,501 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689772350044Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772350287 (+243 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772350287Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772350317 (+30 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689772350381 (+64 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689772350500 (+119 ms) 2023-07-19 13:12:30,505 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:30,507 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 459 msec 2023-07-19 13:12:30,652 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:30,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:30,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33135] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:30,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39417] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-19 13:12:30,682 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,682 DEBUG [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:30,682 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-19 13:12:30,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:30,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689772350700 (current time:1689772350700). 2023-07-19 13:12:30,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-19 13:12:30,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x235dd71a to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:30,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@807d090, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:30,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:30,753 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x235dd71a to 127.0.0.1:64397 2023-07-19 13:12:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:30,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(139): Connect 0x15a3a4b7 to 127.0.0.1:64397 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-19 13:12:30,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588b541e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-19 13:12:30,771 DEBUG [hconnection-0x6ebe8ccf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-19 13:12:30,772 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-19 13:12:30,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15a3a4b7 to 127.0.0.1:64397 2023-07-19 13:12:30,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:12:30,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-19 13:12:30,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-19 13:12:30,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:30,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:30,788 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:30,789 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689772950789 2023-07-19 13:12:30,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-19 13:12:30,789 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,791 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-19 13:12:30,791 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-19 13:12:30,794 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-19 13:12:30,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:30,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 9 msec 2023-07-19 13:12:30,807 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:30,809 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689772950809 2023-07-19 13:12:30,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,845 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-19 13:12:30,845 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,847 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-19 13:12:30,847 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-19 13:12:30,847 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,847 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,850 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,850 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,850 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,850 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,850 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:30,850 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,850 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,852 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,852 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,852 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-19 13:12:30,852 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:30,853 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,856 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:30,856 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:30,856 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:30,858 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,858 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,861 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,861 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:30,861 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:30,861 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,862 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-19 13:12:30,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,863 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:30,863 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:30,863 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34931,1689772233028' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:30,863 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-19 13:12:30,865 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-19 13:12:30,865 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-19 13:12:30,865 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-19 13:12:30,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,867 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,868 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,868 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:30,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,869 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-19 13:12:30,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33135,1689772232949' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:30,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b06333d[Count = 1] remaining members to acquire global barrier 2023-07-19 13:12:30,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:30,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:30,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:30,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:30,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39417,1689772232852' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-19 13:12:30,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b06333d[Count = 0] remaining members to acquire global barrier 2023-07-19 13:12:30,872 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-19 13:12:30,872 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,882 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,882 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,882 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,883 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:30,883 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:30,883 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:30,883 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34931,1689772233028' in zk 2023-07-19 13:12:30,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,883 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:30,883 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-19 13:12:30,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,883 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:30,884 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-19 13:12:30,885 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:30,885 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:30,885 DEBUG [member: 'jenkins-hbase4.apache.org,34931,1689772233028' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:30,886 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:30,890 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:30,891 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:30,890 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-19 13:12:30,891 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-19 13:12:30,891 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. started... 2023-07-19 13:12:30,891 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:30,891 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. started... 2023-07-19 13:12:30,891 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 27c2cec8b5323d746b63c957209746b4 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-19 13:12:30,891 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c19883129de4f6d34cd6a9577e04774b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-19 13:12:30,891 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:30,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:30,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:30,893 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-19 13:12:30,937 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/.tmp/cf/e5425c9def4e41a995f8b306f3f0b0b6 2023-07-19 13:12:30,938 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/.tmp/cf/4f23c341721f422681d06d24978c5b5d 2023-07-19 13:12:30,944 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/.tmp/cf/e5425c9def4e41a995f8b306f3f0b0b6 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf/e5425c9def4e41a995f8b306f3f0b0b6 2023-07-19 13:12:30,951 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/.tmp/cf/4f23c341721f422681d06d24978c5b5d as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf/4f23c341721f422681d06d24978c5b5d 2023-07-19 13:12:30,959 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf/4f23c341721f422681d06d24978c5b5d, entries=5, sequenceid=6, filesize=5.2 K 2023-07-19 13:12:30,960 INFO [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for c19883129de4f6d34cd6a9577e04774b in 69ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:30,960 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-19 13:12:30,961 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c19883129de4f6d34cd6a9577e04774b: 2023-07-19 13:12:30,962 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,962 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:30,962 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf/4f23c341721f422681d06d24978c5b5d] hfiles 2023-07-19 13:12:30,962 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf/4f23c341721f422681d06d24978c5b5d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,967 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf/e5425c9def4e41a995f8b306f3f0b0b6, entries=45, sequenceid=6, filesize=7.9 K 2023-07-19 13:12:30,970 INFO [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 27c2cec8b5323d746b63c957209746b4 in 79ms, sequenceid=6, compaction requested=false 2023-07-19 13:12:30,976 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27c2cec8b5323d746b63c957209746b4: 2023-07-19 13:12:30,976 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:30,976 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-19 13:12:30,977 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf/e5425c9def4e41a995f8b306f3f0b0b6] hfiles 2023-07-19 13:12:30,977 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf/e5425c9def4e41a995f8b306f3f0b0b6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,003 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. completed. 2023-07-19 13:12:31,003 DEBUG [rs(jenkins-hbase4.apache.org,33135,1689772232949)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33135,1689772232949' in zk 2023-07-19 13:12:31,005 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,005 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:31,005 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:31,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,005 DEBUG [member: 'jenkins-hbase4.apache.org,33135,1689772232949' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:31,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,030 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. completed. 2023-07-19 13:12:31,030 DEBUG [rs(jenkins-hbase4.apache.org,39417,1689772232852)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-19 13:12:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-19 13:12:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-19 13:12:31,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39417,1689772232852' in zk 2023-07-19 13:12:31,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,033 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-19 13:12:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,39417,1689772232852' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-19 13:12:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:31,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33135,1689772232949': 2023-07-19 13:12:31,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33135,1689772232949' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-19 13:12:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:31,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:31,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:31,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:31,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39417,1689772232852': 2023-07-19 13:12:31,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39417,1689772232852' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-19 13:12:31,044 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-19 13:12:31,044 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-19 13:12:31,044 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-19 13:12:31,044 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,044 INFO [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-19 13:12:31,048 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:31,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-19 13:12:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-19 13:12:31,049 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,049 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:31,050 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,050 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:31,050 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:31,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-19 13:12:31,051 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-19 13:12:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,055 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,055 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,056 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-19 13:12:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,060 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:31,060 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:31,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:31,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-19 13:12:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:31,061 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:31,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-19 13:12:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-19 13:12:31,063 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:31,063 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:31,063 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,063 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,061 DEBUG [(jenkins-hbase4.apache.org,43411,1689772231278)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-19 13:12:31,093 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:31,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:31,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-19 13:12:31,095 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-19 13:12:31,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,159 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-19 13:12:31,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,160 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689772350789Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689772351061 (+272 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689772351062 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689772351085 (+23 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689772351115 (+30 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689772351159 (+44 ms) 2023-07-19 13:12:31,163 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-19 13:12:31,165 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 372 msec 2023-07-19 13:12:31,395 DEBUG [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-19 13:12:31,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-19 13:12:31,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-19 13:12:31,396 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396 2023-07-19 13:12:31,396 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42099, tgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396, rawTgtDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396, srcFsUri=hdfs://localhost:42099, srcDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:12:31,421 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f 2023-07-19 13:12:31,421 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-854832542_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,421 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42099, inputRoot=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f, snapshotDir=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-19 13:12:31,433 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:31,479 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:31,479 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:31,479 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:31,480 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,674 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-8643602397583769205.jar 2023-07-19 13:12:32,675 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,675 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,752 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/hadoop-5613605946080405923.jar 2023-07-19 13:12:32,753 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,753 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,754 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,754 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,755 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,755 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-19 13:12:32,756 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-19 13:12:32,756 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-19 13:12:32,757 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-19 13:12:32,757 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-19 13:12:32,758 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-19 13:12:32,758 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-19 13:12:32,759 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-19 13:12:32,759 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-19 13:12:32,760 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-19 13:12:32,761 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-19 13:12:32,762 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:32,762 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:32,763 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:32,763 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:32,763 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-19 13:12:32,764 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:32,764 DEBUG [Listener at jenkins-hbase4.apache.org/34975] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-19 13:12:33,390 WARN [Listener at jenkins-hbase4.apache.org/34975] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-19 13:12:33,392 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-19 13:12:33,394 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-19 13:12:33,792 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:33,792 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-19 13:12:33,798 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0006_000001 (auth:SIMPLE) 2023-07-19 13:12:34,322 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:34,525 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:12:39,246 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:41,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:46,232 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689772241838_0007_000001 (auth:SIMPLE) 2023-07-19 13:12:47,660 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-19 13:12:47,660 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-19 13:12:47,687 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:47,687 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-19 13:12:47,688 INFO [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-19 13:12:47,689 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:47,689 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 13:12:47,689 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 13:12:47,689 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_414818060_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:47,690 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-19 13:12:47,690 DEBUG [Listener at jenkins-hbase4.apache.org/34975] snapshot.TestExportSnapshot(367): hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/export-test/export-1689772351396/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-19 13:12:47,698 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:47,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:47,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:47,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 13:12:47,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772367703"}]},"ts":"1689772367703"} 2023-07-19 13:12:47,704 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-19 13:12:47,707 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-19 13:12:47,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, UNASSIGN}] 2023-07-19 13:12:47,710 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, UNASSIGN 2023-07-19 13:12:47,710 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, UNASSIGN 2023-07-19 13:12:47,711 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c19883129de4f6d34cd6a9577e04774b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:12:47,711 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=27c2cec8b5323d746b63c957209746b4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:12:47,711 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772367711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772367711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772367711"}]},"ts":"1689772367711"} 2023-07-19 13:12:47,711 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772367711"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689772367711"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689772367711"}]},"ts":"1689772367711"} 2023-07-19 13:12:47,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure c19883129de4f6d34cd6a9577e04774b, server=jenkins-hbase4.apache.org,33135,1689772232949}] 2023-07-19 13:12:47,714 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 27c2cec8b5323d746b63c957209746b4, server=jenkins-hbase4.apache.org,39417,1689772232852}] 2023-07-19 13:12:47,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 13:12:47,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:47,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c19883129de4f6d34cd6a9577e04774b, disabling compactions & flushes 2023-07-19 13:12:47,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:47,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:47,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. after waiting 0 ms 2023-07-19 13:12:47,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:47,865 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:47,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27c2cec8b5323d746b63c957209746b4, disabling compactions & flushes 2023-07-19 13:12:47,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:47,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:47,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. after waiting 0 ms 2023-07-19 13:12:47,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:47,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:47,895 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:12:47,896 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:47,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4. 2023-07-19 13:12:47,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:12:47,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27c2cec8b5323d746b63c957209746b4: 2023-07-19 13:12:47,900 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b. 2023-07-19 13:12:47,900 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c19883129de4f6d34cd6a9577e04774b: 2023-07-19 13:12:47,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:47,905 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=27c2cec8b5323d746b63c957209746b4, regionState=CLOSED 2023-07-19 13:12:47,905 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772367905"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772367905"}]},"ts":"1689772367905"} 2023-07-19 13:12:47,905 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:47,907 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c19883129de4f6d34cd6a9577e04774b, regionState=CLOSED 2023-07-19 13:12:47,908 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689772367907"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689772367907"}]},"ts":"1689772367907"} 2023-07-19 13:12:47,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-19 13:12:47,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 27c2cec8b5323d746b63c957209746b4, server=jenkins-hbase4.apache.org,39417,1689772232852 in 193 msec 2023-07-19 13:12:47,910 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=27c2cec8b5323d746b63c957209746b4, UNASSIGN in 202 msec 2023-07-19 13:12:47,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-19 13:12:47,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure c19883129de4f6d34cd6a9577e04774b, server=jenkins-hbase4.apache.org,33135,1689772232949 in 196 msec 2023-07-19 13:12:47,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-19 13:12:47,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c19883129de4f6d34cd6a9577e04774b, UNASSIGN in 204 msec 2023-07-19 13:12:47,921 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689772367921"}]},"ts":"1689772367921"} 2023-07-19 13:12:47,922 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-19 13:12:47,925 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-19 13:12:47,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 228 msec 2023-07-19 13:12:48,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-19 13:12:48,008 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-19 13:12:48,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,013 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,014 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,017 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34931] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,020 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,021 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,021 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,021 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:48,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:48,021 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:48,022 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:48,023 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-19 13:12:48,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 13:12:48,027 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:48,031 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/recovered.edits] 2023-07-19 13:12:48,032 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:48,039 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf, FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/recovered.edits] 2023-07-19 13:12:48,044 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf/4f23c341721f422681d06d24978c5b5d to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/cf/4f23c341721f422681d06d24978c5b5d 2023-07-19 13:12:48,045 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf/e5425c9def4e41a995f8b306f3f0b0b6 to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/cf/e5425c9def4e41a995f8b306f3f0b0b6 2023-07-19 13:12:48,048 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b/recovered.edits/9.seqid 2023-07-19 13:12:48,049 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c19883129de4f6d34cd6a9577e04774b 2023-07-19 13:12:48,050 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/recovered.edits/9.seqid to hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4/recovered.edits/9.seqid 2023-07-19 13:12:48,050 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/27c2cec8b5323d746b63c957209746b4 2023-07-19 13:12:48,050 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-19 13:12:48,053 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,061 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-19 13:12:48,071 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-19 13:12:48,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,072 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-19 13:12:48,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772368072"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:48,072 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689772368072"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:48,078 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-19 13:12:48,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c19883129de4f6d34cd6a9577e04774b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689772349267.c19883129de4f6d34cd6a9577e04774b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 27c2cec8b5323d746b63c957209746b4, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689772349267.27c2cec8b5323d746b63c957209746b4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-19 13:12:48,078 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-19 13:12:48,078 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689772368078"}]},"ts":"9223372036854775807"} 2023-07-19 13:12:48,083 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-19 13:12:48,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 77 msec 2023-07-19 13:12:48,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-19 13:12:48,126 INFO [Listener at jenkins-hbase4.apache.org/34975] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-19 13:12:48,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 13:12:48,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-19 13:12:48,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43411] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-19 13:12:48,172 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 764), OpenFileDescriptor=896 (was 916), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=551 (was 538) - SystemLoadAverage LEAK? -, ProcessCount=185 (was 185), AvailableMemoryMB=1296 (was 1911) 2023-07-19 13:12:48,173 WARN [Listener at jenkins-hbase4.apache.org/34975] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-19 13:12:48,173 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-19 13:12:48,187 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:12:48,300 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689772241838_0007_01_000001 is : 143 2023-07-19 13:12:53,508 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-19 13:13:02,318 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:13:16,441 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 13:13:16,442 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:13:16,556 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-19 13:13:16,567 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-19 13:13:16,569 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 13:13:16,588 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-19 13:13:16,691 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-19 13:13:16,691 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-19 13:13:16,691 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-19 13:13:16,691 INFO [Listener at jenkins-hbase4.apache.org/34975] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-19 13:13:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/34975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cbb53b4 to 127.0.0.1:64397 2023-07-19 13:13:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/34975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/34975] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-19 13:13:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/34975] util.JVMClusterUtil(257): Found active master hash=336669109, stopped=false 2023-07-19 13:13:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/34975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,692 DEBUG [Listener at jenkins-hbase4.apache.org/34975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-19 13:13:16,692 INFO [Listener at jenkins-hbase4.apache.org/34975] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:13:16,694 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:16,694 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:16,694 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:16,694 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-19 13:13:16,694 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:13:16,694 INFO [Listener at jenkins-hbase4.apache.org/34975] procedure2.ProcedureExecutor(629): Stopping 2023-07-19 13:13:16,694 DEBUG [Listener at jenkins-hbase4.apache.org/34975] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f834d70 to 127.0.0.1:64397 2023-07-19 13:13:16,694 DEBUG [Listener at jenkins-hbase4.apache.org/34975] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:16,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:16,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:16,695 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-19 13:13:16,695 INFO [Listener at jenkins-hbase4.apache.org/34975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39417,1689772232852' ***** 2023-07-19 13:13:16,695 DEBUG [Listener at jenkins-hbase4.apache.org/34975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,695 INFO [Listener at jenkins-hbase4.apache.org/34975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 13:13:16,695 INFO [Listener at jenkins-hbase4.apache.org/34975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33135,1689772232949' ***** 2023-07-19 13:13:16,695 DEBUG [Listener at jenkins-hbase4.apache.org/34975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,695 INFO [Listener at jenkins-hbase4.apache.org/34975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 13:13:16,695 INFO [RS:0;jenkins-hbase4:39417] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 13:13:16,695 INFO [Listener at jenkins-hbase4.apache.org/34975] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34931,1689772233028' ***** 2023-07-19 13:13:16,695 INFO [RS:1;jenkins-hbase4:33135] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 13:13:16,695 INFO [RS:0;jenkins-hbase4:39417] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 13:13:16,696 INFO [RS:0;jenkins-hbase4:39417] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 13:13:16,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 13:13:16,696 INFO [RS:1;jenkins-hbase4:33135] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 13:13:16,695 DEBUG [Listener at jenkins-hbase4.apache.org/34975] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,696 INFO [RS:1;jenkins-hbase4:33135] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 13:13:16,696 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:13:16,696 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 13:13:16,696 DEBUG [RS:0;jenkins-hbase4:39417] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a526596 to 127.0.0.1:64397 2023-07-19 13:13:16,696 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:13:16,696 INFO [Listener at jenkins-hbase4.apache.org/34975] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-19 13:13:16,696 DEBUG [RS:1;jenkins-hbase4:33135] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e4033d5 to 127.0.0.1:64397 2023-07-19 13:13:16,696 DEBUG [RS:0;jenkins-hbase4:39417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,696 DEBUG [RS:1;jenkins-hbase4:33135] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,698 INFO [RS:2;jenkins-hbase4:34931] regionserver.HeapMemoryManager(220): Stopping 2023-07-19 13:13:16,699 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33135,1689772232949; all regions closed. 2023-07-19 13:13:16,699 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-19 13:13:16,699 INFO [RS:2;jenkins-hbase4:34931] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-19 13:13:16,699 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39417,1689772232852; all regions closed. 2023-07-19 13:13:16,700 INFO [RS:2;jenkins-hbase4:34931] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-19 13:13:16,700 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(3305): Received CLOSE for 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:13:16,700 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(3305): Received CLOSE for 01c1db10903d9b7381868a76322244bc 2023-07-19 13:13:16,700 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:13:16,700 DEBUG [RS:2;jenkins-hbase4:34931] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76486012 to 127.0.0.1:64397 2023-07-19 13:13:16,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5162e4ec2f8caf3a249fd93c09eff31c, disabling compactions & flushes 2023-07-19 13:13:16,701 DEBUG [RS:2;jenkins-hbase4:34931] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:13:16,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:13:16,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. after waiting 0 ms 2023-07-19 13:13:16,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:13:16,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5162e4ec2f8caf3a249fd93c09eff31c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-19 13:13:16,702 INFO [RS:2;jenkins-hbase4:34931] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 13:13:16,702 INFO [RS:2;jenkins-hbase4:34931] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 13:13:16,702 INFO [RS:2;jenkins-hbase4:34931] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 13:13:16,702 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-19 13:13:16,702 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-19 13:13:16,702 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 5162e4ec2f8caf3a249fd93c09eff31c=hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c., 01c1db10903d9b7381868a76322244bc=hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc.} 2023-07-19 13:13:16,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-19 13:13:16,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-19 13:13:16,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-19 13:13:16,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-19 13:13:16,703 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-19 13:13:16,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-19 13:13:16,704 DEBUG [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1504): Waiting on 01c1db10903d9b7381868a76322244bc, 1588230740, 5162e4ec2f8caf3a249fd93c09eff31c 2023-07-19 13:13:16,744 DEBUG [RS:0;jenkins-hbase4:39417] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs 2023-07-19 13:13:16,744 DEBUG [RS:1;jenkins-hbase4:33135] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs 2023-07-19 13:13:16,745 INFO [RS:0;jenkins-hbase4:39417] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39417%2C1689772232852:(num 1689772235164) 2023-07-19 13:13:16,745 INFO [RS:1;jenkins-hbase4:33135] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33135%2C1689772232949:(num 1689772235163) 2023-07-19 13:13:16,745 DEBUG [RS:1;jenkins-hbase4:33135] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,745 DEBUG [RS:0;jenkins-hbase4:39417] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,745 INFO [RS:1;jenkins-hbase4:33135] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:16,745 INFO [RS:0;jenkins-hbase4:39417] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:16,747 INFO [RS:1;jenkins-hbase4:33135] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 13:13:16,747 INFO [RS:0;jenkins-hbase4:39417] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 13:13:16,747 INFO [RS:1;jenkins-hbase4:33135] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 13:13:16,748 INFO [RS:1;jenkins-hbase4:33135] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 13:13:16,749 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:16,749 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:16,750 INFO [RS:0;jenkins-hbase4:39417] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-19 13:13:16,749 INFO [RS:1;jenkins-hbase4:33135] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 13:13:16,751 INFO [RS:0;jenkins-hbase4:39417] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-19 13:13:16,751 INFO [RS:0;jenkins-hbase4:39417] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-19 13:13:16,752 INFO [RS:0;jenkins-hbase4:39417] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39417 2023-07-19 13:13:16,752 INFO [RS:1;jenkins-hbase4:33135] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33135 2023-07-19 13:13:16,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/.tmp/l/26b5f72278ea4049b7b3ab7fb4465d76 2023-07-19 13:13:16,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/.tmp/info/1846ad447ce8436ea220a58d073642e5 2023-07-19 13:13:16,760 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:13:16,760 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:13:16,760 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:16,760 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:16,760 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:16,762 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33135,1689772232949 2023-07-19 13:13:16,762 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:16,764 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:13:16,764 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33135,1689772232949] 2023-07-19 13:13:16,765 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39417,1689772232852 2023-07-19 13:13:16,765 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33135,1689772232949; numProcessing=1 2023-07-19 13:13:16,768 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33135,1689772232949 already deleted, retry=false 2023-07-19 13:13:16,768 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33135,1689772232949 expired; onlineServers=2 2023-07-19 13:13:16,768 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39417,1689772232852] 2023-07-19 13:13:16,769 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39417,1689772232852; numProcessing=2 2023-07-19 13:13:16,769 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39417,1689772232852 already deleted, retry=false 2023-07-19 13:13:16,769 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39417,1689772232852 expired; onlineServers=1 2023-07-19 13:13:16,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26b5f72278ea4049b7b3ab7fb4465d76 2023-07-19 13:13:16,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/.tmp/l/26b5f72278ea4049b7b3ab7fb4465d76 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/l/26b5f72278ea4049b7b3ab7fb4465d76 2023-07-19 13:13:16,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1846ad447ce8436ea220a58d073642e5 2023-07-19 13:13:16,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 26b5f72278ea4049b7b3ab7fb4465d76 2023-07-19 13:13:16,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/l/26b5f72278ea4049b7b3ab7fb4465d76, entries=7, sequenceid=18, filesize=5.2 K 2023-07-19 13:13:16,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5162e4ec2f8caf3a249fd93c09eff31c in 77ms, sequenceid=18, compaction requested=false 2023-07-19 13:13:16,782 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:16,784 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:16,785 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/.tmp/rep_barrier/bee01a91bdb842f290fa76b5fc3179c1 2023-07-19 13:13:16,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/acl/5162e4ec2f8caf3a249fd93c09eff31c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-19 13:13:16,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,787 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:16,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:13:16,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5162e4ec2f8caf3a249fd93c09eff31c: 2023-07-19 13:13:16,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689772236613.5162e4ec2f8caf3a249fd93c09eff31c. 2023-07-19 13:13:16,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01c1db10903d9b7381868a76322244bc, disabling compactions & flushes 2023-07-19 13:13:16,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:13:16,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:13:16,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. after waiting 0 ms 2023-07-19 13:13:16,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:13:16,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 01c1db10903d9b7381868a76322244bc 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-19 13:13:16,789 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bee01a91bdb842f290fa76b5fc3179c1 2023-07-19 13:13:16,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/.tmp/info/165ec1af55624b909aab9f415a5295b0 2023-07-19 13:13:16,803 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/.tmp/table/96ee0819afc74d2e9ce3d23c5ba7cb4f 2023-07-19 13:13:16,807 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96ee0819afc74d2e9ce3d23c5ba7cb4f 2023-07-19 13:13:16,807 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/.tmp/info/1846ad447ce8436ea220a58d073642e5 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/info/1846ad447ce8436ea220a58d073642e5 2023-07-19 13:13:16,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/.tmp/info/165ec1af55624b909aab9f415a5295b0 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/info/165ec1af55624b909aab9f415a5295b0 2023-07-19 13:13:16,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1846ad447ce8436ea220a58d073642e5 2023-07-19 13:13:16,812 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/info/1846ad447ce8436ea220a58d073642e5, entries=48, sequenceid=131, filesize=10.3 K 2023-07-19 13:13:16,813 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/info/165ec1af55624b909aab9f415a5295b0, entries=2, sequenceid=6, filesize=4.8 K 2023-07-19 13:13:16,813 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/.tmp/rep_barrier/bee01a91bdb842f290fa76b5fc3179c1 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/rep_barrier/bee01a91bdb842f290fa76b5fc3179c1 2023-07-19 13:13:16,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 01c1db10903d9b7381868a76322244bc in 27ms, sequenceid=6, compaction requested=false 2023-07-19 13:13:16,820 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bee01a91bdb842f290fa76b5fc3179c1 2023-07-19 13:13:16,821 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/rep_barrier/bee01a91bdb842f290fa76b5fc3179c1, entries=13, sequenceid=131, filesize=6.4 K 2023-07-19 13:13:16,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/namespace/01c1db10903d9b7381868a76322244bc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-19 13:13:16,821 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/.tmp/table/96ee0819afc74d2e9ce3d23c5ba7cb4f as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/table/96ee0819afc74d2e9ce3d23c5ba7cb4f 2023-07-19 13:13:16,822 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:13:16,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01c1db10903d9b7381868a76322244bc: 2023-07-19 13:13:16,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689772235757.01c1db10903d9b7381868a76322244bc. 2023-07-19 13:13:16,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 96ee0819afc74d2e9ce3d23c5ba7cb4f 2023-07-19 13:13:16,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/table/96ee0819afc74d2e9ce3d23c5ba7cb4f, entries=24, sequenceid=131, filesize=6.9 K 2023-07-19 13:13:16,828 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 125ms, sequenceid=131, compaction requested=false 2023-07-19 13:13:16,837 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-19 13:13:16,837 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-19 13:13:16,837 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-19 13:13:16,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-19 13:13:16,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-19 13:13:16,838 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-19 13:13:16,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:16,862 INFO [RS:1;jenkins-hbase4:33135] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33135,1689772232949; zookeeper connection closed. 2023-07-19 13:13:16,862 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:33135-0x1017db489880002, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:16,862 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6c7a52e1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6c7a52e1 2023-07-19 13:13:16,904 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34931,1689772233028; all regions closed. 2023-07-19 13:13:16,911 DEBUG [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs 2023-07-19 13:13:16,912 INFO [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34931%2C1689772233028.meta:.meta(num 1689772235371) 2023-07-19 13:13:16,917 DEBUG [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/oldWALs 2023-07-19 13:13:16,917 INFO [RS:2;jenkins-hbase4:34931] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34931%2C1689772233028:(num 1689772235174) 2023-07-19 13:13:16,917 DEBUG [RS:2;jenkins-hbase4:34931] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,917 INFO [RS:2;jenkins-hbase4:34931] regionserver.LeaseManager(133): Closed leases 2023-07-19 13:13:16,918 INFO [RS:2;jenkins-hbase4:34931] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-19 13:13:16,918 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:16,919 INFO [RS:2;jenkins-hbase4:34931] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34931 2023-07-19 13:13:16,922 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34931,1689772233028 2023-07-19 13:13:16,922 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-19 13:13:16,923 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34931,1689772233028] 2023-07-19 13:13:16,924 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34931,1689772233028; numProcessing=3 2023-07-19 13:13:16,925 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34931,1689772233028 already deleted, retry=false 2023-07-19 13:13:16,925 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34931,1689772233028 expired; onlineServers=0 2023-07-19 13:13:16,925 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43411,1689772231278' ***** 2023-07-19 13:13:16,925 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-19 13:13:16,925 DEBUG [M:0;jenkins-hbase4:43411] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@552c238e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-19 13:13:16,925 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43411,1689772231278 2023-07-19 13:13:16,925 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43411,1689772231278; all regions closed. 2023-07-19 13:13:16,925 DEBUG [M:0;jenkins-hbase4:43411] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-19 13:13:16,925 DEBUG [M:0;jenkins-hbase4:43411] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-19 13:13:16,925 DEBUG [M:0;jenkins-hbase4:43411] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-19 13:13:16,926 INFO [M:0;jenkins-hbase4:43411] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-19 13:13:16,926 INFO [M:0;jenkins-hbase4:43411] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-19 13:13:16,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689772234625] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689772234625,5,FailOnTimeoutGroup] 2023-07-19 13:13:16,926 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-19 13:13:16,926 INFO [M:0;jenkins-hbase4:43411] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-19 13:13:16,926 DEBUG [M:0;jenkins-hbase4:43411] master.HMaster(1512): Stopping service threads 2023-07-19 13:13:16,926 INFO [M:0;jenkins-hbase4:43411] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-19 13:13:16,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689772234625] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689772234625,5,FailOnTimeoutGroup] 2023-07-19 13:13:16,927 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-19 13:13:16,927 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-19 13:13:16,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-19 13:13:16,928 ERROR [M:0;jenkins-hbase4:43411] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-19 13:13:16,929 INFO [M:0;jenkins-hbase4:43411] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-19 13:13:16,929 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-19 13:13:16,929 DEBUG [M:0;jenkins-hbase4:43411] zookeeper.ZKUtil(398): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-19 13:13:16,929 WARN [M:0;jenkins-hbase4:43411] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-19 13:13:16,929 INFO [M:0;jenkins-hbase4:43411] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-19 13:13:16,929 INFO [M:0;jenkins-hbase4:43411] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-19 13:13:16,933 DEBUG [M:0;jenkins-hbase4:43411] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-19 13:13:16,933 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:16,933 DEBUG [M:0;jenkins-hbase4:43411] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:16,933 DEBUG [M:0;jenkins-hbase4:43411] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-19 13:13:16,933 DEBUG [M:0;jenkins-hbase4:43411] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:16,933 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.13 KB heapSize=449.36 KB 2023-07-19 13:13:16,962 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:16,962 INFO [RS:0;jenkins-hbase4:39417] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39417,1689772232852; zookeeper connection closed. 2023-07-19 13:13:16,962 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:39417-0x1017db489880001, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:16,967 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6418d66b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6418d66b 2023-07-19 13:13:16,971 INFO [M:0;jenkins-hbase4:43411] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.13 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1dd6027df4104d008d8a4e2e6742a788 2023-07-19 13:13:16,980 INFO [M:0;jenkins-hbase4:43411] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1dd6027df4104d008d8a4e2e6742a788 2023-07-19 13:13:16,981 DEBUG [M:0;jenkins-hbase4:43411] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/1dd6027df4104d008d8a4e2e6742a788 as hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1dd6027df4104d008d8a4e2e6742a788 2023-07-19 13:13:16,986 INFO [M:0;jenkins-hbase4:43411] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1dd6027df4104d008d8a4e2e6742a788 2023-07-19 13:13:16,986 INFO [M:0;jenkins-hbase4:43411] regionserver.HStore(1080): Added hdfs://localhost:42099/user/jenkins/test-data/ac9a1055-fa41-3088-1ba0-fed51e0c8c7f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/1dd6027df4104d008d8a4e2e6742a788, entries=119, sequenceid=899, filesize=28.4 K 2023-07-19 13:13:16,987 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegion(2948): Finished flush of dataSize ~373.13 KB/382082, heapSize ~449.34 KB/460128, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 54ms, sequenceid=899, compaction requested=false 2023-07-19 13:13:16,989 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-19 13:13:16,989 DEBUG [M:0;jenkins-hbase4:43411] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-19 13:13:16,996 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-19 13:13:16,996 INFO [M:0;jenkins-hbase4:43411] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-19 13:13:16,997 INFO [M:0;jenkins-hbase4:43411] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43411 2023-07-19 13:13:16,999 DEBUG [M:0;jenkins-hbase4:43411] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43411,1689772231278 already deleted, retry=false 2023-07-19 13:13:17,062 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:17,062 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): regionserver:34931-0x1017db489880003, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:17,062 INFO [RS:2;jenkins-hbase4:34931] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34931,1689772233028; zookeeper connection closed. 2023-07-19 13:13:17,064 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@35ac9039] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@35ac9039 2023-07-19 13:13:17,064 INFO [Listener at jenkins-hbase4.apache.org/34975] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-19 13:13:17,162 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:17,162 DEBUG [Listener at localhost/34677-EventThread] zookeeper.ZKWatcher(600): master:43411-0x1017db489880000, quorum=127.0.0.1:64397, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-19 13:13:17,162 INFO [M:0;jenkins-hbase4:43411] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43411,1689772231278; zookeeper connection closed. 2023-07-19 13:13:17,164 WARN [Listener at jenkins-hbase4.apache.org/34975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 13:13:17,168 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:17,273 WARN [BP-2073144932-172.31.14.131-1689772226902 heartbeating to localhost/127.0.0.1:42099] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 13:13:17,273 WARN [BP-2073144932-172.31.14.131-1689772226902 heartbeating to localhost/127.0.0.1:42099] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2073144932-172.31.14.131-1689772226902 (Datanode Uuid 05ca398d-af95-46f7-884d-5e417193760d) service to localhost/127.0.0.1:42099 2023-07-19 13:13:17,275 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data5/current/BP-2073144932-172.31.14.131-1689772226902] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:17,275 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data6/current/BP-2073144932-172.31.14.131-1689772226902] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:17,277 WARN [Listener at jenkins-hbase4.apache.org/34975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 13:13:17,280 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:17,384 WARN [BP-2073144932-172.31.14.131-1689772226902 heartbeating to localhost/127.0.0.1:42099] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 13:13:17,384 WARN [BP-2073144932-172.31.14.131-1689772226902 heartbeating to localhost/127.0.0.1:42099] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2073144932-172.31.14.131-1689772226902 (Datanode Uuid 1d231ea3-2572-46de-81db-23d764146d99) service to localhost/127.0.0.1:42099 2023-07-19 13:13:17,384 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data3/current/BP-2073144932-172.31.14.131-1689772226902] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:17,385 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data4/current/BP-2073144932-172.31.14.131-1689772226902] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:17,386 WARN [Listener at jenkins-hbase4.apache.org/34975] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-19 13:13:17,389 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:17,492 WARN [BP-2073144932-172.31.14.131-1689772226902 heartbeating to localhost/127.0.0.1:42099] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-19 13:13:17,492 WARN [BP-2073144932-172.31.14.131-1689772226902 heartbeating to localhost/127.0.0.1:42099] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2073144932-172.31.14.131-1689772226902 (Datanode Uuid 5e3a56dd-a05e-41a6-a29e-c88f444d4a2f) service to localhost/127.0.0.1:42099 2023-07-19 13:13:17,493 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data1/current/BP-2073144932-172.31.14.131-1689772226902] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:17,494 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/7bb63b42-0f6c-23f7-eca4-6b7e735b0b99/cluster_25d84261-0285-7b88-241c-5031b7eb5100/dfs/data/data2/current/BP-2073144932-172.31.14.131-1689772226902] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-19 13:13:17,522 INFO [Listener at jenkins-hbase4.apache.org/34975] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-19 13:13:17,649 INFO [Listener at jenkins-hbase4.apache.org/34975] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-19 13:13:17,760 INFO [Listener at jenkins-hbase4.apache.org/34975] hbase.HBaseTestingUtility(1293): Minicluster is down