2023-07-12 08:13:58,959 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-12 08:13:59,228 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6 2023-07-12 08:13:59,228 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-12 08:13:59,229 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-12 08:13:59,277 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-12 08:13:59,618 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-12 08:13:59,619 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe, deleteOnExit=true 2023-07-12 08:13:59,619 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-12 08:13:59,620 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/test.cache.data in system properties and HBase conf 2023-07-12 08:13:59,620 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 08:13:59,621 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop.log.dir in system properties and HBase conf 2023-07-12 08:13:59,621 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 08:13:59,622 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 08:13:59,622 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 08:13:59,986 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-12 08:13:59,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:13:59,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:13:59,991 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 08:13:59,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:13:59,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 08:13:59,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 08:13:59,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:13:59,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:13:59,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 08:13:59,994 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/nfs.dump.dir in system properties and HBase conf 2023-07-12 08:13:59,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir in system properties and HBase conf 2023-07-12 08:13:59,995 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:13:59,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 08:13:59,996 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-12 08:14:00,643 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 08:14:00,648 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 08:14:01,031 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-12 08:14:01,275 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-12 08:14:01,293 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:01,338 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:01,389 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_localhost_43669_hdfs____ab1f7o/webapp 2023-07-12 08:14:01,544 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43669 2023-07-12 08:14:01,556 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-12 08:14:01,556 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-12 08:14:02,192 WARN [Listener at localhost/41579] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:02,292 WARN [Listener at localhost/41579] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 08:14:02,317 WARN [Listener at localhost/41579] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:02,393 INFO [Listener at localhost/41579] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:02,401 INFO [Listener at localhost/41579] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_localhost_46343_datanode____.aq3e95/webapp 2023-07-12 08:14:02,539 INFO [Listener at localhost/41579] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46343 2023-07-12 08:14:03,177 WARN [Listener at localhost/42775] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:03,229 WARN [Listener at localhost/42775] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 08:14:03,243 WARN [Listener at localhost/42775] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:03,245 INFO [Listener at localhost/42775] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:03,261 INFO [Listener at localhost/42775] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_localhost_46553_datanode____us0v20/webapp 2023-07-12 08:14:03,405 INFO [Listener at localhost/42775] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46553 2023-07-12 08:14:03,419 WARN [Listener at localhost/34301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:03,480 WARN [Listener at localhost/34301] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-12 08:14:03,484 WARN [Listener at localhost/34301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:03,486 INFO [Listener at localhost/34301] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:03,499 INFO [Listener at localhost/34301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_localhost_46135_datanode____93j3zs/webapp 2023-07-12 08:14:03,650 INFO [Listener at localhost/34301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46135 2023-07-12 08:14:03,688 WARN [Listener at localhost/37289] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-12 08:14:03,953 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa51d37a674ff567e: Processing first storage report for DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6 from datanode 9eb3704e-b89d-4163-be4d-bec4eafbc8f7 2023-07-12 08:14:03,955 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa51d37a674ff567e: from storage DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6 node DatanodeRegistration(127.0.0.1:35183, datanodeUuid=9eb3704e-b89d-4163-be4d-bec4eafbc8f7, infoPort=35477, infoSecurePort=0, ipcPort=34301, storageInfo=lv=-57;cid=testClusterID;nsid=382395343;c=1689149640767), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,956 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9bd09168cf32c4ba: Processing first storage report for DS-2b763952-adc5-4ff4-b813-7aaf76930910 from datanode 745540a5-f4c3-4ecb-9b80-9c01ae152eae 2023-07-12 08:14:03,956 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9bd09168cf32c4ba: from storage DS-2b763952-adc5-4ff4-b813-7aaf76930910 node DatanodeRegistration(127.0.0.1:34287, datanodeUuid=745540a5-f4c3-4ecb-9b80-9c01ae152eae, infoPort=46831, infoSecurePort=0, ipcPort=37289, storageInfo=lv=-57;cid=testClusterID;nsid=382395343;c=1689149640767), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,956 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2086868c4c901991: Processing first storage report for DS-c1657f63-3a25-478d-b489-485e33559e69 from datanode d8add6fe-ce2e-4c07-9a33-241e7cda90ea 2023-07-12 08:14:03,956 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2086868c4c901991: from storage DS-c1657f63-3a25-478d-b489-485e33559e69 node DatanodeRegistration(127.0.0.1:37063, datanodeUuid=d8add6fe-ce2e-4c07-9a33-241e7cda90ea, infoPort=46669, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=382395343;c=1689149640767), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,956 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa51d37a674ff567e: Processing first storage report for DS-4d59303a-f74a-4c99-b760-386b9a7bce25 from datanode 9eb3704e-b89d-4163-be4d-bec4eafbc8f7 2023-07-12 08:14:03,957 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa51d37a674ff567e: from storage DS-4d59303a-f74a-4c99-b760-386b9a7bce25 node DatanodeRegistration(127.0.0.1:35183, datanodeUuid=9eb3704e-b89d-4163-be4d-bec4eafbc8f7, infoPort=35477, infoSecurePort=0, ipcPort=34301, storageInfo=lv=-57;cid=testClusterID;nsid=382395343;c=1689149640767), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,957 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x9bd09168cf32c4ba: Processing first storage report for DS-440b220f-efe6-4e58-a7bd-3f24da65f69c from datanode 745540a5-f4c3-4ecb-9b80-9c01ae152eae 2023-07-12 08:14:03,957 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x9bd09168cf32c4ba: from storage DS-440b220f-efe6-4e58-a7bd-3f24da65f69c node DatanodeRegistration(127.0.0.1:34287, datanodeUuid=745540a5-f4c3-4ecb-9b80-9c01ae152eae, infoPort=46831, infoSecurePort=0, ipcPort=37289, storageInfo=lv=-57;cid=testClusterID;nsid=382395343;c=1689149640767), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:03,957 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2086868c4c901991: Processing first storage report for DS-66b0b6b0-0ae1-4143-a516-c81d80ecc983 from datanode d8add6fe-ce2e-4c07-9a33-241e7cda90ea 2023-07-12 08:14:03,957 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2086868c4c901991: from storage DS-66b0b6b0-0ae1-4143-a516-c81d80ecc983 node DatanodeRegistration(127.0.0.1:37063, datanodeUuid=d8add6fe-ce2e-4c07-9a33-241e7cda90ea, infoPort=46669, infoSecurePort=0, ipcPort=42775, storageInfo=lv=-57;cid=testClusterID;nsid=382395343;c=1689149640767), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-12 08:14:04,256 DEBUG [Listener at localhost/37289] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6 2023-07-12 08:14:04,356 INFO [Listener at localhost/37289] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/zookeeper_0, clientPort=55996, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-12 08:14:04,386 INFO [Listener at localhost/37289] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=55996 2023-07-12 08:14:04,394 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:04,396 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:05,143 INFO [Listener at localhost/37289] util.FSUtils(471): Created version file at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 with version=8 2023-07-12 08:14:05,148 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/hbase-staging 2023-07-12 08:14:05,558 INFO [Listener at localhost/37289] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-12 08:14:06,151 INFO [Listener at localhost/37289] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,193 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,194 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,194 INFO [Listener at localhost/37289] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,194 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,195 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,381 INFO [Listener at localhost/37289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,465 DEBUG [Listener at localhost/37289] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-12 08:14:06,585 INFO [Listener at localhost/37289] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45535 2023-07-12 08:14:06,604 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,607 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,640 INFO [Listener at localhost/37289] zookeeper.RecoverableZooKeeper(93): Process identifier=master:45535 connecting to ZooKeeper ensemble=127.0.0.1:55996 2023-07-12 08:14:06,713 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:455350x0, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:06,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:45535-0x1015898a12d0000 connected 2023-07-12 08:14:06,777 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:06,780 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:06,804 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:06,819 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45535 2023-07-12 08:14:06,822 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45535 2023-07-12 08:14:06,826 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45535 2023-07-12 08:14:06,832 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45535 2023-07-12 08:14:06,833 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45535 2023-07-12 08:14:06,842 INFO [Listener at localhost/37289] master.HMaster(444): hbase.rootdir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, hbase.cluster.distributed=false 2023-07-12 08:14:06,920 INFO [Listener at localhost/37289] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,920 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,920 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,921 INFO [Listener at localhost/37289] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,921 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,921 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,927 INFO [Listener at localhost/37289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,931 INFO [Listener at localhost/37289] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40943 2023-07-12 08:14:06,934 INFO [Listener at localhost/37289] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 08:14:06,942 INFO [Listener at localhost/37289] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 08:14:06,943 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,945 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,947 INFO [Listener at localhost/37289] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40943 connecting to ZooKeeper ensemble=127.0.0.1:55996 2023-07-12 08:14:06,951 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:409430x0, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:06,953 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:409430x0, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:06,955 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:409430x0, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:06,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40943-0x1015898a12d0001 connected 2023-07-12 08:14:06,956 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:06,959 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40943 2023-07-12 08:14:06,960 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40943 2023-07-12 08:14:06,963 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40943 2023-07-12 08:14:06,964 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40943 2023-07-12 08:14:06,965 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40943 2023-07-12 08:14:06,982 INFO [Listener at localhost/37289] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:06,982 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,982 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,983 INFO [Listener at localhost/37289] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:06,983 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:06,983 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:06,983 INFO [Listener at localhost/37289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:06,985 INFO [Listener at localhost/37289] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43379 2023-07-12 08:14:06,986 INFO [Listener at localhost/37289] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 08:14:06,988 INFO [Listener at localhost/37289] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 08:14:06,989 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,992 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:06,994 INFO [Listener at localhost/37289] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43379 connecting to ZooKeeper ensemble=127.0.0.1:55996 2023-07-12 08:14:06,998 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:433790x0, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:07,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43379-0x1015898a12d0002 connected 2023-07-12 08:14:07,000 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:07,001 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:07,002 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:07,002 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43379 2023-07-12 08:14:07,003 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43379 2023-07-12 08:14:07,004 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43379 2023-07-12 08:14:07,005 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43379 2023-07-12 08:14:07,005 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43379 2023-07-12 08:14:07,017 INFO [Listener at localhost/37289] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-12 08:14:07,017 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:07,018 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:07,018 INFO [Listener at localhost/37289] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-12 08:14:07,018 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-12 08:14:07,018 INFO [Listener at localhost/37289] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-12 08:14:07,018 INFO [Listener at localhost/37289] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-12 08:14:07,019 INFO [Listener at localhost/37289] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39637 2023-07-12 08:14:07,020 INFO [Listener at localhost/37289] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-12 08:14:07,021 INFO [Listener at localhost/37289] mob.MobFileCache(124): MobFileCache disabled 2023-07-12 08:14:07,022 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:07,024 INFO [Listener at localhost/37289] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:07,025 INFO [Listener at localhost/37289] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39637 connecting to ZooKeeper ensemble=127.0.0.1:55996 2023-07-12 08:14:07,029 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:396370x0, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-12 08:14:07,030 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:396370x0, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:14:07,030 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:396370x0, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:14:07,031 DEBUG [Listener at localhost/37289] zookeeper.ZKUtil(164): regionserver:396370x0, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-12 08:14:07,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39637-0x1015898a12d0003 connected 2023-07-12 08:14:07,035 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39637 2023-07-12 08:14:07,038 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39637 2023-07-12 08:14:07,040 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39637 2023-07-12 08:14:07,041 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39637 2023-07-12 08:14:07,042 DEBUG [Listener at localhost/37289] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39637 2023-07-12 08:14:07,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:07,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 08:14:07,061 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:07,083 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:07,083 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:07,083 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:07,083 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-12 08:14:07,084 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:07,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 08:14:07,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,45535,1689149645355 from backup master directory 2023-07-12 08:14:07,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-12 08:14:07,095 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:07,096 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-12 08:14:07,096 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:07,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:07,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-12 08:14:07,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-12 08:14:07,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/hbase.id with ID: 5d5e4969-8a22-4ec1-9dd6-e142f925d635 2023-07-12 08:14:07,303 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-12 08:14:07,323 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:07,391 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x26336b82 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:07,435 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c71d6a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:07,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:07,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-12 08:14:07,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-12 08:14:07,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-12 08:14:07,504 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 08:14:07,510 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-12 08:14:07,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:07,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store-tmp 2023-07-12 08:14:07,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:07,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 08:14:07,599 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,599 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 08:14:07,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:14:07,600 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 08:14:07,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/WALs/jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:07,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45535%2C1689149645355, suffix=, logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/WALs/jenkins-hbase4.apache.org,45535,1689149645355, archiveDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/oldWALs, maxLogs=10 2023-07-12 08:14:07,716 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK] 2023-07-12 08:14:07,716 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK] 2023-07-12 08:14:07,716 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK] 2023-07-12 08:14:07,733 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-12 08:14:07,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/WALs/jenkins-hbase4.apache.org,45535,1689149645355/jenkins-hbase4.apache.org%2C45535%2C1689149645355.1689149647646 2023-07-12 08:14:07,828 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK], DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK], DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK]] 2023-07-12 08:14:07,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:07,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:07,835 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,921 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,929 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-12 08:14:07,960 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-12 08:14:07,975 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:07,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:07,999 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-12 08:14:08,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:08,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72205468, jitterRate=0.07594531774520874}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:08,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 08:14:08,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-12 08:14:08,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-12 08:14:08,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-12 08:14:08,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-12 08:14:08,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-12 08:14:08,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 38 msec 2023-07-12 08:14:08,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-12 08:14:08,105 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-12 08:14:08,112 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-12 08:14:08,140 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-12 08:14:08,145 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-12 08:14:08,147 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-12 08:14:08,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-12 08:14:08,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-12 08:14:08,164 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-12 08:14:08,167 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-12 08:14:08,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-12 08:14:08,190 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,190 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,190 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,190 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-12 08:14:08,191 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,45535,1689149645355, sessionid=0x1015898a12d0000, setting cluster-up flag (Was=false) 2023-07-12 08:14:08,210 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-12 08:14:08,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:08,231 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:08,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-12 08:14:08,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:08,247 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp 2023-07-12 08:14:08,357 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(951): ClusterId : 5d5e4969-8a22-4ec1-9dd6-e142f925d635 2023-07-12 08:14:08,389 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(951): ClusterId : 5d5e4969-8a22-4ec1-9dd6-e142f925d635 2023-07-12 08:14:08,390 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(951): ClusterId : 5d5e4969-8a22-4ec1-9dd6-e142f925d635 2023-07-12 08:14:08,394 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 08:14:08,410 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 08:14:08,412 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-12 08:14:08,418 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 08:14:08,418 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 08:14:08,419 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 08:14:08,419 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 08:14:08,420 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-12 08:14:08,420 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-12 08:14:08,423 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 08:14:08,425 DEBUG [RS:1;jenkins-hbase4:43379] zookeeper.ReadOnlyZKClient(139): Connect 0x01840301 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:08,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-12 08:14:08,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-12 08:14:08,436 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 08:14:08,438 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-12 08:14:08,440 DEBUG [RS:0;jenkins-hbase4:40943] zookeeper.ReadOnlyZKClient(139): Connect 0x01fd1575 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:08,447 DEBUG [RS:2;jenkins-hbase4:39637] zookeeper.ReadOnlyZKClient(139): Connect 0x0fd7b187 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:08,462 DEBUG [RS:1;jenkins-hbase4:43379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f43fd41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:08,463 DEBUG [RS:1;jenkins-hbase4:43379] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b7c6871, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:14:08,464 DEBUG [RS:0;jenkins-hbase4:40943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@f3aeb3a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:08,464 DEBUG [RS:0;jenkins-hbase4:40943] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b057e05, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:14:08,486 DEBUG [RS:2;jenkins-hbase4:39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1104e0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:08,487 DEBUG [RS:2;jenkins-hbase4:39637] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@402d4436, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:14:08,511 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39637 2023-07-12 08:14:08,512 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43379 2023-07-12 08:14:08,519 INFO [RS:2;jenkins-hbase4:39637] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 08:14:08,519 INFO [RS:2;jenkins-hbase4:39637] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 08:14:08,519 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40943 2023-07-12 08:14:08,520 INFO [RS:1;jenkins-hbase4:43379] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 08:14:08,520 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 08:14:08,519 INFO [RS:0;jenkins-hbase4:40943] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-12 08:14:08,521 INFO [RS:0;jenkins-hbase4:40943] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 08:14:08,520 INFO [RS:1;jenkins-hbase4:43379] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-12 08:14:08,522 INFO [RS:2;jenkins-hbase4:39637] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,522 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 08:14:08,522 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-12 08:14:08,522 INFO [RS:1;jenkins-hbase4:43379] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,522 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 08:14:08,523 INFO [RS:0;jenkins-hbase4:40943] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:08,523 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 08:14:08,523 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1022): About to register with Master. 2023-07-12 08:14:08,530 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45535,1689149645355 with isa=jenkins-hbase4.apache.org/172.31.14.131:39637, startcode=1689149647017 2023-07-12 08:14:08,531 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45535,1689149645355 with isa=jenkins-hbase4.apache.org/172.31.14.131:43379, startcode=1689149646981 2023-07-12 08:14:08,531 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45535,1689149645355 with isa=jenkins-hbase4.apache.org/172.31.14.131:40943, startcode=1689149646919 2023-07-12 08:14:08,556 DEBUG [RS:0;jenkins-hbase4:40943] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 08:14:08,556 DEBUG [RS:2;jenkins-hbase4:39637] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 08:14:08,556 DEBUG [RS:1;jenkins-hbase4:43379] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-12 08:14:08,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-12 08:14:08,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-12 08:14:08,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-12 08:14:08,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:08,575 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689149678588 2023-07-12 08:14:08,592 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-12 08:14:08,610 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 08:14:08,611 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-12 08:14:08,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-12 08:14:08,619 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:08,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-12 08:14:08,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-12 08:14:08,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-12 08:14:08,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-12 08:14:08,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,634 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59059, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 08:14:08,634 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43417, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 08:14:08,634 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49537, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-12 08:14:08,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-12 08:14:08,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-12 08:14:08,640 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-12 08:14:08,651 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45535] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 08:14:08,662 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45535] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 08:14:08,663 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45535] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-12 08:14:08,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-12 08:14:08,665 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-12 08:14:08,675 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689149648667,5,FailOnTimeoutGroup] 2023-07-12 08:14:08,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689149648675,5,FailOnTimeoutGroup] 2023-07-12 08:14:08,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-12 08:14:08,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,702 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 08:14:08,703 WARN [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 08:14:08,711 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 08:14:08,711 WARN [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 08:14:08,712 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(2830): Master is not running yet 2023-07-12 08:14:08,712 WARN [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-12 08:14:08,761 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:08,762 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:08,762 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:08,805 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45535,1689149645355 with isa=jenkins-hbase4.apache.org/172.31.14.131:43379, startcode=1689149646981 2023-07-12 08:14:08,812 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:08,813 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45535,1689149645355 with isa=jenkins-hbase4.apache.org/172.31.14.131:39637, startcode=1689149647017 2023-07-12 08:14:08,816 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,45535,1689149645355 with isa=jenkins-hbase4.apache.org/172.31.14.131:40943, startcode=1689149646919 2023-07-12 08:14:08,825 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:08,826 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=45535] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:08,831 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:08,831 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41579 2023-07-12 08:14:08,831 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 08:14:08,834 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:08,835 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41579 2023-07-12 08:14:08,835 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 08:14:08,834 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:08,835 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:41579 2023-07-12 08:14:08,836 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-12 08:14:08,836 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:14:08,844 DEBUG [RS:2;jenkins-hbase4:39637] zookeeper.ZKUtil(162): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:08,845 WARN [RS:2;jenkins-hbase4:39637] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:08,845 INFO [RS:2;jenkins-hbase4:39637] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:08,845 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:08,847 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:14:08,848 DEBUG [RS:0;jenkins-hbase4:40943] zookeeper.ZKUtil(162): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:08,848 DEBUG [RS:1;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:08,850 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39637,1689149647017] 2023-07-12 08:14:08,851 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40943,1689149646919] 2023-07-12 08:14:08,851 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43379,1689149646981] 2023-07-12 08:14:08,848 WARN [RS:0;jenkins-hbase4:40943] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:08,848 WARN [RS:1;jenkins-hbase4:43379] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-12 08:14:08,858 INFO [RS:0;jenkins-hbase4:40943] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:08,862 INFO [RS:1;jenkins-hbase4:43379] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:08,862 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:08,862 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1948): logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:08,896 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:08,898 DEBUG [RS:1;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:08,899 DEBUG [RS:0;jenkins-hbase4:40943] zookeeper.ZKUtil(162): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:08,899 DEBUG [RS:2;jenkins-hbase4:39637] zookeeper.ZKUtil(162): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:08,899 DEBUG [RS:1;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:08,900 DEBUG [RS:1;jenkins-hbase4:43379] zookeeper.ZKUtil(162): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:08,900 DEBUG [RS:0;jenkins-hbase4:40943] zookeeper.ZKUtil(162): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:08,901 DEBUG [RS:0;jenkins-hbase4:40943] zookeeper.ZKUtil(162): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:08,901 DEBUG [RS:2;jenkins-hbase4:39637] zookeeper.ZKUtil(162): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:08,903 DEBUG [RS:2;jenkins-hbase4:39637] zookeeper.ZKUtil(162): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:08,916 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 08:14:08,917 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 08:14:08,917 DEBUG [RS:2;jenkins-hbase4:39637] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 08:14:08,917 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-12 08:14:08,921 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/info 2023-07-12 08:14:08,922 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 08:14:08,924 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:08,924 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 08:14:08,927 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/rep_barrier 2023-07-12 08:14:08,928 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 08:14:08,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:08,929 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 08:14:08,932 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/table 2023-07-12 08:14:08,932 INFO [RS:0;jenkins-hbase4:40943] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 08:14:08,932 INFO [RS:1;jenkins-hbase4:43379] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 08:14:08,932 INFO [RS:2;jenkins-hbase4:39637] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-12 08:14:08,933 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 08:14:08,934 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:08,935 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740 2023-07-12 08:14:08,936 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740 2023-07-12 08:14:08,943 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 08:14:08,950 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 08:14:08,960 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:08,961 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63418622, jitterRate=-0.05498889088630676}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 08:14:08,961 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 08:14:08,961 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 08:14:08,961 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 08:14:08,961 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 08:14:08,961 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 08:14:08,961 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 08:14:08,963 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 08:14:08,963 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 08:14:08,965 INFO [RS:2;jenkins-hbase4:39637] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 08:14:08,965 INFO [RS:0;jenkins-hbase4:40943] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 08:14:08,971 INFO [RS:1;jenkins-hbase4:43379] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-12 08:14:08,974 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-12 08:14:08,974 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-12 08:14:08,975 INFO [RS:0;jenkins-hbase4:40943] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 08:14:08,975 INFO [RS:1;jenkins-hbase4:43379] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 08:14:08,976 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,975 INFO [RS:2;jenkins-hbase4:39637] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-12 08:14:08,976 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,976 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,980 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 08:14:08,980 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 08:14:08,984 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-12 08:14:08,992 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,992 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,992 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-12 08:14:08,993 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,993 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,999 DEBUG [RS:2;jenkins-hbase4:39637] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:08,993 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,008 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:08,994 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,012 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,012 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,013 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:1;jenkins-hbase4:43379] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,012 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,014 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,015 DEBUG [RS:0;jenkins-hbase4:40943] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-12 08:14:09,022 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,023 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,023 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,039 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-12 08:14:09,051 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,051 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,051 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,060 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-12 08:14:09,074 INFO [RS:2;jenkins-hbase4:39637] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 08:14:09,074 INFO [RS:0;jenkins-hbase4:40943] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 08:14:09,074 INFO [RS:1;jenkins-hbase4:43379] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-12 08:14:09,080 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39637,1689149647017-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,080 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43379,1689149646981-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,080 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40943,1689149646919-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,130 INFO [RS:1;jenkins-hbase4:43379] regionserver.Replication(203): jenkins-hbase4.apache.org,43379,1689149646981 started 2023-07-12 08:14:09,130 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43379,1689149646981, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43379, sessionid=0x1015898a12d0002 2023-07-12 08:14:09,131 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 08:14:09,131 DEBUG [RS:1;jenkins-hbase4:43379] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:09,131 DEBUG [RS:1;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43379,1689149646981' 2023-07-12 08:14:09,131 DEBUG [RS:1;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 08:14:09,133 DEBUG [RS:1;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 08:14:09,134 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 08:14:09,134 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 08:14:09,135 DEBUG [RS:1;jenkins-hbase4:43379] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:09,135 DEBUG [RS:1;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43379,1689149646981' 2023-07-12 08:14:09,135 DEBUG [RS:1;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:09,136 DEBUG [RS:1;jenkins-hbase4:43379] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:09,137 DEBUG [RS:1;jenkins-hbase4:43379] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 08:14:09,139 INFO [RS:0;jenkins-hbase4:40943] regionserver.Replication(203): jenkins-hbase4.apache.org,40943,1689149646919 started 2023-07-12 08:14:09,141 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40943,1689149646919, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40943, sessionid=0x1015898a12d0001 2023-07-12 08:14:09,141 INFO [RS:1;jenkins-hbase4:43379] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 08:14:09,142 INFO [RS:1;jenkins-hbase4:43379] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 08:14:09,146 INFO [RS:2;jenkins-hbase4:39637] regionserver.Replication(203): jenkins-hbase4.apache.org,39637,1689149647017 started 2023-07-12 08:14:09,146 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 08:14:09,146 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39637,1689149647017, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39637, sessionid=0x1015898a12d0003 2023-07-12 08:14:09,146 DEBUG [RS:0;jenkins-hbase4:40943] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:09,147 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-12 08:14:09,147 DEBUG [RS:2;jenkins-hbase4:39637] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:09,147 DEBUG [RS:0;jenkins-hbase4:40943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40943,1689149646919' 2023-07-12 08:14:09,148 DEBUG [RS:0;jenkins-hbase4:40943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 08:14:09,147 DEBUG [RS:2;jenkins-hbase4:39637] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39637,1689149647017' 2023-07-12 08:14:09,148 DEBUG [RS:2;jenkins-hbase4:39637] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-12 08:14:09,149 DEBUG [RS:0;jenkins-hbase4:40943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 08:14:09,149 DEBUG [RS:2;jenkins-hbase4:39637] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-12 08:14:09,149 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 08:14:09,149 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-12 08:14:09,150 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 08:14:09,150 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-12 08:14:09,150 DEBUG [RS:0;jenkins-hbase4:40943] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:09,150 DEBUG [RS:2;jenkins-hbase4:39637] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:09,150 DEBUG [RS:0;jenkins-hbase4:40943] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40943,1689149646919' 2023-07-12 08:14:09,150 DEBUG [RS:2;jenkins-hbase4:39637] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39637,1689149647017' 2023-07-12 08:14:09,150 DEBUG [RS:2;jenkins-hbase4:39637] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:09,150 DEBUG [RS:0;jenkins-hbase4:40943] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:09,151 DEBUG [RS:2;jenkins-hbase4:39637] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:09,151 DEBUG [RS:0;jenkins-hbase4:40943] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:09,152 DEBUG [RS:2;jenkins-hbase4:39637] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 08:14:09,152 DEBUG [RS:0;jenkins-hbase4:40943] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-12 08:14:09,152 INFO [RS:2;jenkins-hbase4:39637] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 08:14:09,152 INFO [RS:0;jenkins-hbase4:40943] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-12 08:14:09,154 INFO [RS:2;jenkins-hbase4:39637] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 08:14:09,154 INFO [RS:0;jenkins-hbase4:40943] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-12 08:14:09,214 DEBUG [jenkins-hbase4:45535] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-12 08:14:09,218 DEBUG [jenkins-hbase4:45535] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:09,225 DEBUG [jenkins-hbase4:45535] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:09,225 DEBUG [jenkins-hbase4:45535] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:09,225 DEBUG [jenkins-hbase4:45535] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:09,225 DEBUG [jenkins-hbase4:45535] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:09,228 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40943,1689149646919, state=OPENING 2023-07-12 08:14:09,236 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-12 08:14:09,238 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:09,239 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 08:14:09,242 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:14:09,254 INFO [RS:1;jenkins-hbase4:43379] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43379%2C1689149646981, suffix=, logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,43379,1689149646981, archiveDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs, maxLogs=32 2023-07-12 08:14:09,258 INFO [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40943%2C1689149646919, suffix=, logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,40943,1689149646919, archiveDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs, maxLogs=32 2023-07-12 08:14:09,263 INFO [RS:2;jenkins-hbase4:39637] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39637%2C1689149647017, suffix=, logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,39637,1689149647017, archiveDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs, maxLogs=32 2023-07-12 08:14:09,293 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK] 2023-07-12 08:14:09,294 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK] 2023-07-12 08:14:09,313 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK] 2023-07-12 08:14:09,316 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK] 2023-07-12 08:14:09,316 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK] 2023-07-12 08:14:09,316 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK] 2023-07-12 08:14:09,321 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK] 2023-07-12 08:14:09,323 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK] 2023-07-12 08:14:09,332 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK] 2023-07-12 08:14:09,347 INFO [RS:2;jenkins-hbase4:39637] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,39637,1689149647017/jenkins-hbase4.apache.org%2C39637%2C1689149647017.1689149649265 2023-07-12 08:14:09,348 INFO [RS:1;jenkins-hbase4:43379] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,43379,1689149646981/jenkins-hbase4.apache.org%2C43379%2C1689149646981.1689149649256 2023-07-12 08:14:09,348 INFO [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,40943,1689149646919/jenkins-hbase4.apache.org%2C40943%2C1689149646919.1689149649260 2023-07-12 08:14:09,352 DEBUG [RS:2;jenkins-hbase4:39637] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK], DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK], DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK]] 2023-07-12 08:14:09,362 DEBUG [RS:1;jenkins-hbase4:43379] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK], DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK], DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK]] 2023-07-12 08:14:09,363 DEBUG [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK], DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK], DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK]] 2023-07-12 08:14:09,433 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:09,436 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:14:09,441 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:14:09,472 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-12 08:14:09,472 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-12 08:14:09,492 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40943%2C1689149646919.meta, suffix=.meta, logDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,40943,1689149646919, archiveDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs, maxLogs=32 2023-07-12 08:14:09,533 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK] 2023-07-12 08:14:09,536 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK] 2023-07-12 08:14:09,536 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK] 2023-07-12 08:14:09,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/WALs/jenkins-hbase4.apache.org,40943,1689149646919/jenkins-hbase4.apache.org%2C40943%2C1689149646919.meta.1689149649494.meta 2023-07-12 08:14:09,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34287,DS-2b763952-adc5-4ff4-b813-7aaf76930910,DISK], DatanodeInfoWithStorage[127.0.0.1:37063,DS-c1657f63-3a25-478d-b489-485e33559e69,DISK], DatanodeInfoWithStorage[127.0.0.1:35183,DS-f69a9fa4-c681-4662-a655-55a4e3f5bdd6,DISK]] 2023-07-12 08:14:09,571 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:09,572 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-12 08:14:09,574 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:09,577 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-12 08:14:09,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-12 08:14:09,582 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-12 08:14:09,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-12 08:14:09,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:09,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-12 08:14:09,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-12 08:14:09,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-12 08:14:09,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/info 2023-07-12 08:14:09,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/info 2023-07-12 08:14:09,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-12 08:14:09,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:09,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-12 08:14:09,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/rep_barrier 2023-07-12 08:14:09,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/rep_barrier 2023-07-12 08:14:09,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-12 08:14:09,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:09,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-12 08:14:09,625 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/table 2023-07-12 08:14:09,626 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/table 2023-07-12 08:14:09,627 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-12 08:14:09,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:09,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740 2023-07-12 08:14:09,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740 2023-07-12 08:14:09,640 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-12 08:14:09,642 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-12 08:14:09,645 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72949917, jitterRate=0.08703847229480743}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-12 08:14:09,648 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-12 08:14:09,660 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689149649425 2023-07-12 08:14:09,688 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40943,1689149646919, state=OPEN 2023-07-12 08:14:09,692 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-12 08:14:09,693 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-12 08:14:09,696 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-12 08:14:09,696 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-12 08:14:09,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-12 08:14:09,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40943,1689149646919 in 454 msec 2023-07-12 08:14:09,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-12 08:14:09,717 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 711 msec 2023-07-12 08:14:09,726 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2680 sec 2023-07-12 08:14:09,726 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689149649726, completionTime=-1 2023-07-12 08:14:09,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-12 08:14:09,729 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-12 08:14:09,817 DEBUG [hconnection-0x1aa22286-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:09,825 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:09,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-12 08:14:09,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689149709855 2023-07-12 08:14:09,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689149769855 2023-07-12 08:14:09,855 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 126 msec 2023-07-12 08:14:09,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45535,1689149645355-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45535,1689149645355-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45535,1689149645355-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,889 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:45535, period=300000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-12 08:14:09,899 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-12 08:14:09,907 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-12 08:14:09,908 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:09,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-12 08:14:09,921 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:09,925 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:09,949 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:09,953 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c empty. 2023-07-12 08:14:09,953 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:09,954 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-12 08:14:10,000 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:10,004 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 88083edd14c6143fb6576172bcb0e04c, NAME => 'hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:10,026 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:10,026 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 88083edd14c6143fb6576172bcb0e04c, disabling compactions & flushes 2023-07-12 08:14:10,027 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,027 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,027 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. after waiting 0 ms 2023-07-12 08:14:10,027 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,027 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,027 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 88083edd14c6143fb6576172bcb0e04c: 2023-07-12 08:14:10,032 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:10,049 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689149650035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149650035"}]},"ts":"1689149650035"} 2023-07-12 08:14:10,081 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 08:14:10,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:10,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149650085"}]},"ts":"1689149650085"} 2023-07-12 08:14:10,097 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-12 08:14:10,102 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:10,104 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:10,104 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:10,104 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:10,104 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:10,106 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=88083edd14c6143fb6576172bcb0e04c, ASSIGN}] 2023-07-12 08:14:10,109 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=88083edd14c6143fb6576172bcb0e04c, ASSIGN 2023-07-12 08:14:10,111 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=88083edd14c6143fb6576172bcb0e04c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:14:10,263 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 08:14:10,265 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=88083edd14c6143fb6576172bcb0e04c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:10,265 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689149650264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149650264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149650264"}]},"ts":"1689149650264"} 2023-07-12 08:14:10,271 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 88083edd14c6143fb6576172bcb0e04c, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:14:10,433 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 88083edd14c6143fb6576172bcb0e04c, NAME => 'hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:10,433 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. service=AccessControlService 2023-07-12 08:14:10,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:10,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:10,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,437 INFO [StoreOpener-88083edd14c6143fb6576172bcb0e04c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,440 DEBUG [StoreOpener-88083edd14c6143fb6576172bcb0e04c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/info 2023-07-12 08:14:10,440 DEBUG [StoreOpener-88083edd14c6143fb6576172bcb0e04c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/info 2023-07-12 08:14:10,440 INFO [StoreOpener-88083edd14c6143fb6576172bcb0e04c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 88083edd14c6143fb6576172bcb0e04c columnFamilyName info 2023-07-12 08:14:10,441 INFO [StoreOpener-88083edd14c6143fb6576172bcb0e04c-1] regionserver.HStore(310): Store=88083edd14c6143fb6576172bcb0e04c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:10,443 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:14:10,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:10,452 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 88083edd14c6143fb6576172bcb0e04c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74176413, jitterRate=0.10531468689441681}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:10,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 88083edd14c6143fb6576172bcb0e04c: 2023-07-12 08:14:10,454 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c., pid=6, masterSystemTime=1689149650425 2023-07-12 08:14:10,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,457 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:14:10,459 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=88083edd14c6143fb6576172bcb0e04c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:10,459 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689149650458"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149650458"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149650458"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149650458"}]},"ts":"1689149650458"} 2023-07-12 08:14:10,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-12 08:14:10,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 88083edd14c6143fb6576172bcb0e04c, server=jenkins-hbase4.apache.org,40943,1689149646919 in 191 msec 2023-07-12 08:14:10,470 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-12 08:14:10,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=88083edd14c6143fb6576172bcb0e04c, ASSIGN in 360 msec 2023-07-12 08:14:10,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:10,473 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149650472"}]},"ts":"1689149650472"} 2023-07-12 08:14:10,475 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-12 08:14:10,479 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:10,482 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 570 msec 2023-07-12 08:14:10,522 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-12 08:14:10,524 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-12 08:14:10,524 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:10,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-12 08:14:10,579 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 08:14:10,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2023-07-12 08:14:10,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-12 08:14:10,607 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-12 08:14:10,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2023-07-12 08:14:10,623 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-12 08:14:10,627 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-12 08:14:10,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.530sec 2023-07-12 08:14:10,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-12 08:14:10,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-12 08:14:10,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-12 08:14:10,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45535,1689149645355-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-12 08:14:10,635 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45535,1689149645355-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-12 08:14:10,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-12 08:14:10,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-12 08:14:10,663 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:10,666 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:10,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-12 08:14:10,669 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:10,670 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba empty. 2023-07-12 08:14:10,672 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:10,673 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-12 08:14:10,677 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:10,699 DEBUG [Listener at localhost/37289] zookeeper.ReadOnlyZKClient(139): Connect 0x39a9e5ab to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:10,705 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:10,709 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1ce0e83033c63e3981be4286bb8737ba, NAME => 'hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:10,710 DEBUG [Listener at localhost/37289] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52f9184c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:10,733 DEBUG [hconnection-0x4b95d417-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:10,746 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:10,746 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1ce0e83033c63e3981be4286bb8737ba, disabling compactions & flushes 2023-07-12 08:14:10,747 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:10,747 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:10,747 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. after waiting 0 ms 2023-07-12 08:14:10,747 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:10,747 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:10,747 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1ce0e83033c63e3981be4286bb8737ba: 2023-07-12 08:14:10,755 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54086, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:10,755 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:10,757 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689149650757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149650757"}]},"ts":"1689149650757"} 2023-07-12 08:14:10,758 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:14:10,758 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-12 08:14:10,758 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/test.cache.data in system properties and HBase conf 2023-07-12 08:14:10,758 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop.tmp.dir in system properties and HBase conf 2023-07-12 08:14:10,758 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop.log.dir in system properties and HBase conf 2023-07-12 08:14:10,758 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:14:10,759 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/nfs.dump.dir in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir in system properties and HBase conf 2023-07-12 08:14:10,760 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-12 08:14:10,761 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-12 08:14:10,761 INFO [Listener at localhost/37289] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-12 08:14:10,763 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-12 08:14:10,766 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:10,767 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149650766"}]},"ts":"1689149650766"} 2023-07-12 08:14:10,770 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-12 08:14:10,775 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:10,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:10,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:10,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:10,776 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:10,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1ce0e83033c63e3981be4286bb8737ba, ASSIGN}] 2023-07-12 08:14:10,780 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1ce0e83033c63e3981be4286bb8737ba, ASSIGN 2023-07-12 08:14:10,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:10,782 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1ce0e83033c63e3981be4286bb8737ba, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689149646981; forceNewPlan=false, retain=false 2023-07-12 08:14:10,933 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 08:14:10,934 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1ce0e83033c63e3981be4286bb8737ba, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:10,934 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689149650934"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149650934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149650934"}]},"ts":"1689149650934"} 2023-07-12 08:14:10,938 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1ce0e83033c63e3981be4286bb8737ba, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:14:10,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:11,109 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:11,110 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:14:11,122 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48718, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:14:11,165 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:11,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1ce0e83033c63e3981be4286bb8737ba, NAME => 'hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:14:11,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. service=AccessControlService 2023-07-12 08:14:11,166 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:11,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:11,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,175 INFO [StoreOpener-1ce0e83033c63e3981be4286bb8737ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,179 DEBUG [StoreOpener-1ce0e83033c63e3981be4286bb8737ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/l 2023-07-12 08:14:11,180 DEBUG [StoreOpener-1ce0e83033c63e3981be4286bb8737ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/l 2023-07-12 08:14:11,180 INFO [StoreOpener-1ce0e83033c63e3981be4286bb8737ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1ce0e83033c63e3981be4286bb8737ba columnFamilyName l 2023-07-12 08:14:11,183 INFO [StoreOpener-1ce0e83033c63e3981be4286bb8737ba-1] regionserver.HStore(310): Store=1ce0e83033c63e3981be4286bb8737ba/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:11,194 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,196 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,204 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:14:11,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:11,216 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1ce0e83033c63e3981be4286bb8737ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66814776, jitterRate=-0.0043822526931762695}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:11,217 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1ce0e83033c63e3981be4286bb8737ba: 2023-07-12 08:14:11,220 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba., pid=11, masterSystemTime=1689149651109 2023-07-12 08:14:11,226 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:11,228 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1ce0e83033c63e3981be4286bb8737ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:11,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689149651228"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149651228"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149651228"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149651228"}]},"ts":"1689149651228"} 2023-07-12 08:14:11,232 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:14:11,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-12 08:14:11,239 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1ce0e83033c63e3981be4286bb8737ba, server=jenkins-hbase4.apache.org,43379,1689149646981 in 296 msec 2023-07-12 08:14:11,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-12 08:14:11,244 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1ce0e83033c63e3981be4286bb8737ba, ASSIGN in 463 msec 2023-07-12 08:14:11,245 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:11,245 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149651245"}]},"ts":"1689149651245"} 2023-07-12 08:14:11,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-12 08:14:11,255 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:11,258 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 596 msec 2023-07-12 08:14:11,283 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-12 08:14:11,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-12 08:14:11,298 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-12 08:14:12,314 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:12,697 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:12,705 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_43267_jobhistory____ui8b7h/webapp 2023-07-12 08:14:12,882 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-12 08:14:12,882 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:12,882 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:12,886 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:12,973 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:13,320 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:13,776 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-12 08:14:13,820 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:43267 2023-07-12 08:14:15,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:14:15,526 WARN [Listener at jenkins-hbase4.apache.org/38411] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:15,555 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-12 08:14:15,557 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-12 08:14:15,559 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-12 08:14:15,560 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:15,561 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-12 08:14:15,561 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:15,561 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-12 08:14:15,562 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 08:14:15,562 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-12 08:14:15,562 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:15,562 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-12 08:14:15,562 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 08:14:15,562 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-12 08:14:15,637 WARN [Listener at jenkins-hbase4.apache.org/38411] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 08:14:15,638 INFO [Listener at jenkins-hbase4.apache.org/38411] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:15,648 INFO [Listener at jenkins-hbase4.apache.org/38411] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36565_cluster____.6e9sh9/webapp 2023-07-12 08:14:15,742 INFO [Listener at jenkins-hbase4.apache.org/38411] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:15,742 INFO [Listener at jenkins-hbase4.apache.org/38411] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-12 08:14:15,743 INFO [Listener at jenkins-hbase4.apache.org/38411] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:15,747 INFO [Listener at jenkins-hbase4.apache.org/38411] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:15,759 INFO [Listener at jenkins-hbase4.apache.org/38411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,023 INFO [Listener at jenkins-hbase4.apache.org/38411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,136 INFO [Listener at jenkins-hbase4.apache.org/38411] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,145 INFO [Listener at jenkins-hbase4.apache.org/38411] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36565 2023-07-12 08:14:16,622 WARN [Listener at jenkins-hbase4.apache.org/35263] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:16,652 WARN [Listener at jenkins-hbase4.apache.org/35263] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 08:14:16,653 INFO [Listener at jenkins-hbase4.apache.org/35263] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:16,661 INFO [Listener at jenkins-hbase4.apache.org/35263] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46589_node____.st4zny/webapp 2023-07-12 08:14:16,722 INFO [Listener at jenkins-hbase4.apache.org/35263] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 08:14:16,723 INFO [Listener at jenkins-hbase4.apache.org/35263] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:16,723 INFO [Listener at jenkins-hbase4.apache.org/35263] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:16,723 INFO [Listener at jenkins-hbase4.apache.org/35263] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:16,734 INFO [Listener at jenkins-hbase4.apache.org/35263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,763 INFO [Listener at jenkins-hbase4.apache.org/35263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,928 INFO [Listener at jenkins-hbase4.apache.org/35263] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:16,959 INFO [Listener at jenkins-hbase4.apache.org/35263] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46589 2023-07-12 08:14:17,225 WARN [Listener at jenkins-hbase4.apache.org/35773] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-12 08:14:17,235 WARN [Listener at jenkins-hbase4.apache.org/35773] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-12 08:14:17,236 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): jetty-6.1.26 2023-07-12 08:14:17,252 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36613_node____6d4jbn/webapp 2023-07-12 08:14:17,324 INFO [Listener at jenkins-hbase4.apache.org/35773] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-12 08:14:17,324 INFO [Listener at jenkins-hbase4.apache.org/35773] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-12 08:14:17,324 INFO [Listener at jenkins-hbase4.apache.org/35773] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-12 08:14:17,324 INFO [Listener at jenkins-hbase4.apache.org/35773] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-12 08:14:17,335 INFO [Listener at jenkins-hbase4.apache.org/35773] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:17,357 INFO [Listener at jenkins-hbase4.apache.org/35773] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:17,446 INFO [Listener at jenkins-hbase4.apache.org/35773] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-12 08:14:17,454 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36613 2023-07-12 08:14:17,488 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-12 08:14:17,490 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:17,565 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=381, ProcessCount=173, AvailableMemoryMB=5230 2023-07-12 08:14:17,565 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-12 08:14:17,583 DEBUG [Listener at jenkins-hbase4.apache.org/35773] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-12 08:14:17,590 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-12 08:14:17,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 08:14:17,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:17,604 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:17,605 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-12 08:14:17,607 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:17,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:17,612 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:17,612 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:17,614 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 empty. 2023-07-12 08:14:17,614 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 empty. 2023-07-12 08:14:17,615 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:17,616 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:17,616 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 08:14:17,651 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:17,653 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 05b49fb23a116a0eed57ae0a360d6776, NAME => 'testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:17,653 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8c9effeb6fce66c55d9009cf2ab20ee4, NAME => 'testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:17,694 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:17,694 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 8c9effeb6fce66c55d9009cf2ab20ee4, disabling compactions & flushes 2023-07-12 08:14:17,694 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:17,694 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:17,694 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. after waiting 0 ms 2023-07-12 08:14:17,694 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:17,694 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:17,694 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 8c9effeb6fce66c55d9009cf2ab20ee4: 2023-07-12 08:14:17,697 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:17,698 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 05b49fb23a116a0eed57ae0a360d6776, disabling compactions & flushes 2023-07-12 08:14:17,698 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:17,698 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:17,698 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. after waiting 0 ms 2023-07-12 08:14:17,698 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:17,698 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:17,698 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 05b49fb23a116a0eed57ae0a360d6776: 2023-07-12 08:14:17,702 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:17,704 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149657704"}]},"ts":"1689149657704"} 2023-07-12 08:14:17,704 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149657704"}]},"ts":"1689149657704"} 2023-07-12 08:14:17,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:17,754 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:14:17,756 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:17,756 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149657756"}]},"ts":"1689149657756"} 2023-07-12 08:14:17,759 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-12 08:14:17,764 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:17,766 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:17,766 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:17,766 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:17,766 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:17,766 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, ASSIGN}] 2023-07-12 08:14:17,770 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, ASSIGN 2023-07-12 08:14:17,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, ASSIGN 2023-07-12 08:14:17,775 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:14:17,775 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39637,1689149647017; forceNewPlan=false, retain=false 2023-07-12 08:14:17,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:17,925 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:14:17,928 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8c9effeb6fce66c55d9009cf2ab20ee4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:17,928 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=05b49fb23a116a0eed57ae0a360d6776, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:17,929 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149657928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149657928"}]},"ts":"1689149657928"} 2023-07-12 08:14:17,929 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149657928"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149657928"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149657928"}]},"ts":"1689149657928"} 2023-07-12 08:14:17,932 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 8c9effeb6fce66c55d9009cf2ab20ee4, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:14:17,934 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 05b49fb23a116a0eed57ae0a360d6776, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:14:18,098 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,098 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:14:18,102 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:14:18,110 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:18,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c9effeb6fce66c55d9009cf2ab20ee4, NAME => 'testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:14:18,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. service=AccessControlService 2023-07-12 08:14:18,111 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:18,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:18,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,116 INFO [StoreOpener-8c9effeb6fce66c55d9009cf2ab20ee4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,125 DEBUG [StoreOpener-8c9effeb6fce66c55d9009cf2ab20ee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf 2023-07-12 08:14:18,125 DEBUG [StoreOpener-8c9effeb6fce66c55d9009cf2ab20ee4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf 2023-07-12 08:14:18,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:18,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 05b49fb23a116a0eed57ae0a360d6776, NAME => 'testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:14:18,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. service=AccessControlService 2023-07-12 08:14:18,131 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:18,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:18,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,131 INFO [StoreOpener-8c9effeb6fce66c55d9009cf2ab20ee4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c9effeb6fce66c55d9009cf2ab20ee4 columnFamilyName cf 2023-07-12 08:14:18,134 INFO [StoreOpener-05b49fb23a116a0eed57ae0a360d6776-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,135 INFO [StoreOpener-8c9effeb6fce66c55d9009cf2ab20ee4-1] regionserver.HStore(310): Store=8c9effeb6fce66c55d9009cf2ab20ee4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:18,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,143 DEBUG [StoreOpener-05b49fb23a116a0eed57ae0a360d6776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf 2023-07-12 08:14:18,143 DEBUG [StoreOpener-05b49fb23a116a0eed57ae0a360d6776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf 2023-07-12 08:14:18,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,144 INFO [StoreOpener-05b49fb23a116a0eed57ae0a360d6776-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 05b49fb23a116a0eed57ae0a360d6776 columnFamilyName cf 2023-07-12 08:14:18,146 INFO [StoreOpener-05b49fb23a116a0eed57ae0a360d6776-1] regionserver.HStore(310): Store=05b49fb23a116a0eed57ae0a360d6776/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:18,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:18,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:18,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:18,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 05b49fb23a116a0eed57ae0a360d6776; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67347448, jitterRate=0.0035551786422729492}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:18,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 05b49fb23a116a0eed57ae0a360d6776: 2023-07-12 08:14:18,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776., pid=16, masterSystemTime=1689149658116 2023-07-12 08:14:18,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:18,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c9effeb6fce66c55d9009cf2ab20ee4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61061239, jitterRate=-0.09011663496494293}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:18,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c9effeb6fce66c55d9009cf2ab20ee4: 2023-07-12 08:14:18,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4., pid=15, masterSystemTime=1689149658098 2023-07-12 08:14:18,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:18,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:18,181 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=05b49fb23a116a0eed57ae0a360d6776, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149658181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149658181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149658181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149658181"}]},"ts":"1689149658181"} 2023-07-12 08:14:18,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:18,184 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:18,185 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=8c9effeb6fce66c55d9009cf2ab20ee4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,186 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149658185"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149658185"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149658185"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149658185"}]},"ts":"1689149658185"} 2023-07-12 08:14:18,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-12 08:14:18,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 05b49fb23a116a0eed57ae0a360d6776, server=jenkins-hbase4.apache.org,40943,1689149646919 in 253 msec 2023-07-12 08:14:18,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-12 08:14:18,198 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 8c9effeb6fce66c55d9009cf2ab20ee4, server=jenkins-hbase4.apache.org,39637,1689149647017 in 257 msec 2023-07-12 08:14:18,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, ASSIGN in 427 msec 2023-07-12 08:14:18,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-12 08:14:18,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, ASSIGN in 432 msec 2023-07-12 08:14:18,205 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:18,205 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149658205"}]},"ts":"1689149658205"} 2023-07-12 08:14:18,208 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-12 08:14:18,212 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:18,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:18,219 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-12 08:14:18,227 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,231 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,239 DEBUG [hconnection-0x27e6ff67-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,242 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,254 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 08:14:18,289 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,289 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,289 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:14:18,289 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,289 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:18,298 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:18,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,298 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,299 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:18,303 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 701 msec 2023-07-12 08:14:18,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-12 08:14:18,717 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-12 08:14:18,722 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 08:14:18,724 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:18,726 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:18,755 DEBUG [hconnection-0x4b95d417-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,760 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:18,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149658776 (current time:1689149658776). 2023-07-12 08:14:18,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:18,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x2f4d9ce5 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:18,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@380f4bab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:18,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,787 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f4d9ce5 to 127.0.0.1:55996 2023-07-12 08:14:18,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:18,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x2c5b4dfd to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:18,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67a376e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:18,799 DEBUG [hconnection-0x5a6fc92c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,800 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54120, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:18,806 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:18,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c5b4dfd to 127.0.0.1:55996 2023-07-12 08:14:18,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:18,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 08:14:18,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:18,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:18,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:18,855 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:18,857 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689150258857 2023-07-12 08:14:18,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:18,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 08:14:18,863 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:18,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:18,866 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-12 08:14:18,868 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:18,868 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:18,868 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:18,869 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689150258869 2023-07-12 08:14:18,904 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,905 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-12 08:14:18,905 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,906 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 08:14:18,906 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 08:14:18,906 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,907 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:18,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:18,913 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:18,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:18,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:18,913 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,913 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,914 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:18,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:18,914 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,914 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:18,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,914 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 08:14:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 08:14:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,917 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:18,917 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:18,919 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,920 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,921 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:18,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:18,922 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-12 08:14:18,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,923 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:18,923 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,923 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:18,924 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:18,925 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:18,925 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:18,925 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:18,926 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,927 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,927 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,927 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,928 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:18,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:18,930 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,930 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:18,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:18,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a519ea[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:18,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:18,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:18,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:18,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:18,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:18,937 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a519ea[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:18,937 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 08:14:18,937 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:18,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,940 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:18,940 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:18,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:14:18,941 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:18,941 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:18,942 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:18,942 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. started... 2023-07-12 08:14:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:18,942 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:18,942 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:18,943 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. started... 2023-07-12 08:14:18,945 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:18,945 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:18,945 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:18,947 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05b49fb23a116a0eed57ae0a360d6776: 2023-07-12 08:14:18,947 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c9effeb6fce66c55d9009cf2ab20ee4: 2023-07-12 08:14:18,948 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,948 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:18,954 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:18,954 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:18,958 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:18,958 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:18,968 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:18,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:18,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:18,974 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:19,000 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. completed. 2023-07-12 08:14:19,001 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:19,001 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:19,001 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:19,001 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,002 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:14:19,004 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,004 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,004 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,005 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,008 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. completed. 2023-07-12 08:14:19,008 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:19,008 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:19,008 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:19,008 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,008 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,008 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:14:19,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,011 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,011 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:14:19,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 08:14:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:14:19,030 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 08:14:19,030 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-12 08:14:19,030 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:19,030 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:19,030 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,030 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:19,035 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,035 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,035 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,035 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,036 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,036 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,037 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,038 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,041 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,041 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,042 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,042 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,042 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,059 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,060 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:19,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,063 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 08:14:19,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,065 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:14:19,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:19,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 08:14:19,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,169 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,174 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:19,178 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:14:19,216 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 08:14:19,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,217 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:19,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689149658858Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689149659098 (+240 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689149659098Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689149659098Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689149659124 (+26 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689149659155 (+31 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689149659216 (+61 ms) 2023-07-12 08:14:19,219 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:19,222 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 358 msec 2023-07-12 08:14:19,479 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:19,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:19,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:19,502 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-12 08:14:19,502 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:19,502 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:19,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:19,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149659518 (current time:1689149659518). 2023-07-12 08:14:19,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:19,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x4a4571fe to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:19,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43d0e010, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:19,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,529 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4a4571fe to 127.0.0.1:55996 2023-07-12 08:14:19,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:19,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x507adf31 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:19,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31d19e41, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:19,539 DEBUG [hconnection-0x7545280b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,544 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:19,552 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48748, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:19,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x507adf31 to 127.0.0.1:55996 2023-07-12 08:14:19,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:19,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-12 08:14:19,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:19,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:19,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:19,561 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:19,563 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689150259563 2023-07-12 08:14:19,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-12 08:14:19,563 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-12 08:14:19,564 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:19,564 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:19,566 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-12 08:14:19,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:19,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-12 08:14:19,569 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:19,569 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689150259569 2023-07-12 08:14:19,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-12 08:14:19,593 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-12 08:14:19,593 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,595 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-12 08:14:19,595 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-12 08:14:19,596 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,596 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:19,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:19,599 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,600 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,600 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:19,601 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:19,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 08:14:19,602 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:19,602 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 08:14:19,602 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,603 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:19,603 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:19,603 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:19,603 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:19,604 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,607 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:19,607 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:19,607 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:19,607 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,607 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-12 08:14:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,610 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-12 08:14:19,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-12 08:14:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-12 08:14:19,612 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:19,613 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-12 08:14:19,613 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-12 08:14:19,613 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-12 08:14:19,614 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,614 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,614 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,616 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,616 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:19,617 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,618 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:19,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f425e1[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:19,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-12 08:14:19,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9f425e1[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:19,625 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-12 08:14:19,625 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,631 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,631 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,631 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,632 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:19,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-12 08:14:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,632 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:14:19,632 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,632 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:19,634 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:19,639 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,639 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. started... 2023-07-12 08:14:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,639 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,639 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 05b49fb23a116a0eed57ae0a360d6776 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 08:14:19,642 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:19,643 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:19,643 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:19,645 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. started... 2023-07-12 08:14:19,645 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8c9effeb6fce66c55d9009cf2ab20ee4 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 08:14:19,664 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:19,666 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:19,814 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712574fde1773454e0b9083a7dee86d6449 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712574fde1773454e0b9083a7dee86d6449 2023-07-12 08:14:19,850 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/.tmp/cf/69dd24e31f634f0eb46e512b17406117 2023-07-12 08:14:19,862 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/.tmp/cf/69dd24e31f634f0eb46e512b17406117 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf/69dd24e31f634f0eb46e512b17406117 2023-07-12 08:14:19,867 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:19,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:19,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:19,871 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:14:19,873 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf/69dd24e31f634f0eb46e512b17406117, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 08:14:19,875 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 05b49fb23a116a0eed57ae0a360d6776 in 236ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:19,876 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-12 08:14:19,877 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 05b49fb23a116a0eed57ae0a360d6776: 2023-07-12 08:14:19,877 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:19,877 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:19,877 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf/69dd24e31f634f0eb46e512b17406117] hfiles 2023-07-12 08:14:19,877 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf/69dd24e31f634f0eb46e512b17406117 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:19,899 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. completed. 2023-07-12 08:14:19,900 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:19,900 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:19,900 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:19,900 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,900 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:19,900 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:14:19,902 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:19,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:19,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:19,902 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:19,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:19,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:14:19,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-12 08:14:20,171 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:20,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:20,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:20,173 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:14:20,178 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712942cc1cb6b48463eb28f1ec0493862f3 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712942cc1cb6b48463eb28f1ec0493862f3 2023-07-12 08:14:20,199 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/.tmp/cf/b9594169b23242caaa07461da72beab7 2023-07-12 08:14:20,209 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/.tmp/cf/b9594169b23242caaa07461da72beab7 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf/b9594169b23242caaa07461da72beab7 2023-07-12 08:14:20,219 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf/b9594169b23242caaa07461da72beab7, entries=46, sequenceid=6, filesize=12.6 K 2023-07-12 08:14:20,222 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8c9effeb6fce66c55d9009cf2ab20ee4 in 577ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:20,228 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c9effeb6fce66c55d9009cf2ab20ee4: 2023-07-12 08:14:20,228 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:20,228 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:20,228 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf/b9594169b23242caaa07461da72beab7] hfiles 2023-07-12 08:14:20,228 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf/b9594169b23242caaa07461da72beab7 for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:20,247 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. completed. 2023-07-12 08:14:20,247 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:20,247 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:20,248 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:20,248 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,248 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-12 08:14:20,248 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:14:20,250 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,250 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-12 08:14:20,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:20,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:20,250 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:20,250 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-12 08:14:20,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:20,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:14:20,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-12 08:14:20,255 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-12 08:14:20,255 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:20,255 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:20,255 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-12 08:14:20,255 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:20,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:20,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,257 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,257 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,258 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,259 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,261 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:20,261 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-12 08:14:20,262 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:20,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:20,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:20,274 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:20,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:20,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-12 08:14:20,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,273 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:20,274 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-12 08:14:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:20,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:14:20,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:20,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,275 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:20,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:20,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712942cc1cb6b48463eb28f1ec0493862f3, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712574fde1773454e0b9083a7dee86d6449] mob files 2023-07-12 08:14:20,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712942cc1cb6b48463eb28f1ec0493862f3 2023-07-12 08:14:20,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712574fde1773454e0b9083a7dee86d6449 2023-07-12 08:14:20,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-12 08:14:20,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-12 08:14:20,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,379 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-12 08:14:20,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689149659563Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689149660293 (+730 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689149660293Loading Region manifests for snaptb0-testExportWithTargetName at 1689149660293Writing data manifest for snaptb0-testExportWithTargetName at 1689149660298 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689149660314 (+16 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689149660379 (+65 ms) 2023-07-12 08:14:20,381 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-12 08:14:20,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 818 msec 2023-07-12 08:14:20,674 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:20,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-12 08:14:20,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:20,677 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677 2023-07-12 08:14:20,678 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41579, tgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677, rawTgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:20,716 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:20,716 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1749433426_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 08:14:20,717 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-12 08:14:20,737 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-12 08:14:21,222 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,222 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,223 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:21,224 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,294 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-5405802401792062778.jar 2023-07-12 08:14:22,295 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,296 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,376 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-4539876124142501397.jar 2023-07-12 08:14:22,377 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,378 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,379 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,379 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,380 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,381 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:22,381 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:14:22,382 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:14:22,383 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:14:22,383 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:14:22,384 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:14:22,385 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:14:22,385 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:14:22,386 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:14:22,387 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:14:22,388 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:14:22,393 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:22,394 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:22,394 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:22,395 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:22,395 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:22,396 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:22,397 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:23,631 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:14:23,740 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:14:23,759 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-12 08:14:23,774 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 08:14:24,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:24,310 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:24,689 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:29,809 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:32,104 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:35,933 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:37,710 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:14:37,712 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:14:37,724 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-12 08:14:37,724 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:14:37,727 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:14:37,727 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-12 08:14:37,728 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-12 08:14:37,728 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-12 08:14:37,728 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677/.hbase-snapshot/testExportWithTargetName 2023-07-12 08:14:37,729 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-12 08:14:37,729 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149660677/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-12 08:14:37,739 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-12 08:14:37,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-12 08:14:37,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:37,758 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149677758"}]},"ts":"1689149677758"} 2023-07-12 08:14:37,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 08:14:37,760 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-12 08:14:37,762 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-12 08:14:37,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, UNASSIGN}] 2023-07-12 08:14:37,767 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, UNASSIGN 2023-07-12 08:14:37,767 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, UNASSIGN 2023-07-12 08:14:37,768 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8c9effeb6fce66c55d9009cf2ab20ee4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:37,768 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=05b49fb23a116a0eed57ae0a360d6776, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:37,768 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149677768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149677768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149677768"}]},"ts":"1689149677768"} 2023-07-12 08:14:37,768 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149677768"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149677768"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149677768"}]},"ts":"1689149677768"} 2023-07-12 08:14:37,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 8c9effeb6fce66c55d9009cf2ab20ee4, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:14:37,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 05b49fb23a116a0eed57ae0a360d6776, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:14:37,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 08:14:37,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:37,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 05b49fb23a116a0eed57ae0a360d6776, disabling compactions & flushes 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c9effeb6fce66c55d9009cf2ab20ee4, disabling compactions & flushes 2023-07-12 08:14:37,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:37,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. after waiting 0 ms 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. after waiting 0 ms 2023-07-12 08:14:37,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:37,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:37,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:37,954 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:37,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:37,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4. 2023-07-12 08:14:37,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776. 2023-07-12 08:14:37,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 05b49fb23a116a0eed57ae0a360d6776: 2023-07-12 08:14:37,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c9effeb6fce66c55d9009cf2ab20ee4: 2023-07-12 08:14:37,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:37,959 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=05b49fb23a116a0eed57ae0a360d6776, regionState=CLOSED 2023-07-12 08:14:37,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:37,959 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149677959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149677959"}]},"ts":"1689149677959"} 2023-07-12 08:14:37,960 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8c9effeb6fce66c55d9009cf2ab20ee4, regionState=CLOSED 2023-07-12 08:14:37,960 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689149677960"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149677960"}]},"ts":"1689149677960"} 2023-07-12 08:14:37,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-12 08:14:37,968 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 05b49fb23a116a0eed57ae0a360d6776, server=jenkins-hbase4.apache.org,40943,1689149646919 in 186 msec 2023-07-12 08:14:37,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-12 08:14:37,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 8c9effeb6fce66c55d9009cf2ab20ee4, server=jenkins-hbase4.apache.org,39637,1689149647017 in 193 msec 2023-07-12 08:14:37,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=05b49fb23a116a0eed57ae0a360d6776, UNASSIGN in 204 msec 2023-07-12 08:14:37,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-12 08:14:37,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=8c9effeb6fce66c55d9009cf2ab20ee4, UNASSIGN in 206 msec 2023-07-12 08:14:37,974 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149677973"}]},"ts":"1689149677973"} 2023-07-12 08:14:37,975 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-12 08:14:37,977 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-12 08:14:37,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 230 msec 2023-07-12 08:14:38,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-12 08:14:38,062 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-12 08:14:38,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-12 08:14:38,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:38,077 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:38,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-12 08:14:38,079 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:38,082 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-12 08:14:38,085 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:38,085 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:38,086 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,086 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,086 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,086 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 08:14:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 08:14:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 08:14:38,087 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,089 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,089 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/recovered.edits] 2023-07-12 08:14:38,089 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/recovered.edits] 2023-07-12 08:14:38,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 08:14:38,098 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf/b9594169b23242caaa07461da72beab7 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/cf/b9594169b23242caaa07461da72beab7 2023-07-12 08:14:38,098 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf/69dd24e31f634f0eb46e512b17406117 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/cf/69dd24e31f634f0eb46e512b17406117 2023-07-12 08:14:38,102 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4/recovered.edits/9.seqid 2023-07-12 08:14:38,102 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776/recovered.edits/9.seqid 2023-07-12 08:14:38,103 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/8c9effeb6fce66c55d9009cf2ab20ee4 2023-07-12 08:14:38,103 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportWithTargetName/05b49fb23a116a0eed57ae0a360d6776 2023-07-12 08:14:38,103 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-12 08:14:38,103 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 08:14:38,104 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-12 08:14:38,108 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712942cc1cb6b48463eb28f1ec0493862f3 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230712942cc1cb6b48463eb28f1ec0493862f3 2023-07-12 08:14:38,110 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712574fde1773454e0b9083a7dee86d6449 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230712574fde1773454e0b9083a7dee86d6449 2023-07-12 08:14:38,110 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-12 08:14:38,113 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:38,143 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-12 08:14:38,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-12 08:14:38,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:38,148 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-12 08:14:38,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149678148"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:38,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149678148"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:38,150 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:14:38,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 05b49fb23a116a0eed57ae0a360d6776, NAME => 'testtb-testExportWithTargetName,,1689149657597.05b49fb23a116a0eed57ae0a360d6776.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8c9effeb6fce66c55d9009cf2ab20ee4, NAME => 'testtb-testExportWithTargetName,1,1689149657597.8c9effeb6fce66c55d9009cf2ab20ee4.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:14:38,150 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-12 08:14:38,151 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149678150"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:38,153 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-12 08:14:38,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-12 08:14:38,158 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 88 msec 2023-07-12 08:14:38,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-12 08:14:38,195 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-12 08:14:38,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-12 08:14:38,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-12 08:14:38,218 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-12 08:14:38,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-12 08:14:38,251 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 704) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:35263 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1847518858_1 at /127.0.0.1:36490 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:35618 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1318 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:45097 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:37373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:58366 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=370 (was 381), ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=3414 (was 5230) 2023-07-12 08:14:38,254 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 08:14:38,280 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=370, ProcessCount=179, AvailableMemoryMB=3414 2023-07-12 08:14:38,280 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-12 08:14:38,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 08:14:38,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:38,289 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:38,290 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-12 08:14:38,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:38,294 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:38,298 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,298 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,298 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e empty. 2023-07-12 08:14:38,298 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 empty. 2023-07-12 08:14:38,299 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,299 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,299 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 08:14:38,318 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:38,320 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 26bbde77f04689ee3dffe3765eaf6432, NAME => 'testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:38,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => f3fd9f30c63daf1a47fcb2f7d598822e, NAME => 'testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:38,339 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:38,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing f3fd9f30c63daf1a47fcb2f7d598822e, disabling compactions & flushes 2023-07-12 08:14:38,342 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. after waiting 0 ms 2023-07-12 08:14:38,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,342 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,342 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for f3fd9f30c63daf1a47fcb2f7d598822e: 2023-07-12 08:14:38,347 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:38,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 26bbde77f04689ee3dffe3765eaf6432, disabling compactions & flushes 2023-07-12 08:14:38,348 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. after waiting 0 ms 2023-07-12 08:14:38,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,348 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,348 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 26bbde77f04689ee3dffe3765eaf6432: 2023-07-12 08:14:38,352 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:38,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149678353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149678353"}]},"ts":"1689149678353"} 2023-07-12 08:14:38,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149678353"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149678353"}]},"ts":"1689149678353"} 2023-07-12 08:14:38,358 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:14:38,360 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:38,360 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149678360"}]},"ts":"1689149678360"} 2023-07-12 08:14:38,362 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 08:14:38,366 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:38,367 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:38,368 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:38,368 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:38,368 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:38,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, ASSIGN}] 2023-07-12 08:14:38,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, ASSIGN 2023-07-12 08:14:38,371 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, ASSIGN 2023-07-12 08:14:38,372 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689149646981; forceNewPlan=false, retain=false 2023-07-12 08:14:38,372 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39637,1689149647017; forceNewPlan=false, retain=false 2023-07-12 08:14:38,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:38,523 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:14:38,525 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f3fd9f30c63daf1a47fcb2f7d598822e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:38,525 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=26bbde77f04689ee3dffe3765eaf6432, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:38,526 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149678525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149678525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149678525"}]},"ts":"1689149678525"} 2023-07-12 08:14:38,526 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149678525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149678525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149678525"}]},"ts":"1689149678525"} 2023-07-12 08:14:38,528 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 26bbde77f04689ee3dffe3765eaf6432, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:14:38,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure f3fd9f30c63daf1a47fcb2f7d598822e, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:14:38,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:38,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 26bbde77f04689ee3dffe3765eaf6432, NAME => 'testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:14:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. service=AccessControlService 2023-07-12 08:14:38,690 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:38,690 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:38,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,691 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f3fd9f30c63daf1a47fcb2f7d598822e, NAME => 'testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:14:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. service=AccessControlService 2023-07-12 08:14:38,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:38,692 INFO [StoreOpener-26bbde77f04689ee3dffe3765eaf6432-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:38,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,694 INFO [StoreOpener-f3fd9f30c63daf1a47fcb2f7d598822e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,696 DEBUG [StoreOpener-f3fd9f30c63daf1a47fcb2f7d598822e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf 2023-07-12 08:14:38,696 DEBUG [StoreOpener-f3fd9f30c63daf1a47fcb2f7d598822e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf 2023-07-12 08:14:38,697 INFO [StoreOpener-f3fd9f30c63daf1a47fcb2f7d598822e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f3fd9f30c63daf1a47fcb2f7d598822e columnFamilyName cf 2023-07-12 08:14:38,700 INFO [StoreOpener-f3fd9f30c63daf1a47fcb2f7d598822e-1] regionserver.HStore(310): Store=f3fd9f30c63daf1a47fcb2f7d598822e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:38,702 DEBUG [StoreOpener-26bbde77f04689ee3dffe3765eaf6432-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf 2023-07-12 08:14:38,703 DEBUG [StoreOpener-26bbde77f04689ee3dffe3765eaf6432-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf 2023-07-12 08:14:38,704 INFO [StoreOpener-26bbde77f04689ee3dffe3765eaf6432-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 26bbde77f04689ee3dffe3765eaf6432 columnFamilyName cf 2023-07-12 08:14:38,707 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,708 INFO [StoreOpener-26bbde77f04689ee3dffe3765eaf6432-1] regionserver.HStore(310): Store=26bbde77f04689ee3dffe3765eaf6432/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:38,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:38,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:38,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:38,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f3fd9f30c63daf1a47fcb2f7d598822e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69372394, jitterRate=0.033729225397109985}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:38,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f3fd9f30c63daf1a47fcb2f7d598822e: 2023-07-12 08:14:38,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e., pid=31, masterSystemTime=1689149678681 2023-07-12 08:14:38,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:38,723 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:38,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 26bbde77f04689ee3dffe3765eaf6432; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60304001, jitterRate=-0.10140036046504974}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:38,724 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 26bbde77f04689ee3dffe3765eaf6432: 2023-07-12 08:14:38,724 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432., pid=30, masterSystemTime=1689149678680 2023-07-12 08:14:38,726 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=f3fd9f30c63daf1a47fcb2f7d598822e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:38,726 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,726 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,726 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149678726"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149678726"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149678726"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149678726"}]},"ts":"1689149678726"} 2023-07-12 08:14:38,727 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=26bbde77f04689ee3dffe3765eaf6432, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:38,727 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149678727"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149678727"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149678727"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149678727"}]},"ts":"1689149678727"} 2023-07-12 08:14:38,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-12 08:14:38,734 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure f3fd9f30c63daf1a47fcb2f7d598822e, server=jenkins-hbase4.apache.org,43379,1689149646981 in 201 msec 2023-07-12 08:14:38,739 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-12 08:14:38,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, ASSIGN in 368 msec 2023-07-12 08:14:38,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 26bbde77f04689ee3dffe3765eaf6432, server=jenkins-hbase4.apache.org,39637,1689149647017 in 203 msec 2023-07-12 08:14:38,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-12 08:14:38,751 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, ASSIGN in 371 msec 2023-07-12 08:14:38,752 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:38,752 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149678752"}]},"ts":"1689149678752"} 2023-07-12 08:14:38,755 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 08:14:38,757 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:38,758 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-12 08:14:38,760 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:14:38,762 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,762 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,763 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,763 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:38,766 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:38,766 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:38,766 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:38,766 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:38,766 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:38,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:38,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:38,767 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:38,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 481 msec 2023-07-12 08:14:38,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-12 08:14:38,896 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-12 08:14:38,900 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 08:14:38,900 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:38,903 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:38,918 DEBUG [hconnection-0x4b95d417-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:38,924 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:38,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:38,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149678929 (current time:1689149678929). 2023-07-12 08:14:38,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:38,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x374b1933 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:38,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73bd219d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:38,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:38,946 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44020, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:38,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x374b1933 to 127.0.0.1:55996 2023-07-12 08:14:38,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:38,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x381805d3 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:38,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57f50162, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:38,959 DEBUG [hconnection-0x4d5e73c8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:38,963 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:38,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:38,969 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:38,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x381805d3 to 127.0.0.1:55996 2023-07-12 08:14:38,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:38,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:14:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:38,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:38,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:38,979 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:38,983 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150278983 2023-07-12 08:14:38,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:38,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 08:14:38,986 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:38,986 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:38,988 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:38,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:38,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 15 msec 2023-07-12 08:14:38,992 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:38,993 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150278993 2023-07-12 08:14:39,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,017 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-12 08:14:39,017 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,024 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 08:14:39,024 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:14:39,025 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,025 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,026 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,026 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,027 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,026 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,028 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,029 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,029 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,029 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:39,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,031 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:39,031 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:39,031 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,031 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,032 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:39,030 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:39,033 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:39,034 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:39,045 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,045 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,045 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,045 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,046 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:39,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:39,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61545bcb[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:39,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:39,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61545bcb[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:39,055 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:14:39,055 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:39,057 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:39,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:39,058 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:39,057 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:14:39,058 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,058 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:39,058 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:39,058 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:39,058 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. started... 2023-07-12 08:14:39,058 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. started... 2023-07-12 08:14:39,059 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26bbde77f04689ee3dffe3765eaf6432: 2023-07-12 08:14:39,060 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3fd9f30c63daf1a47fcb2f7d598822e: 2023-07-12 08:14:39,060 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,060 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,060 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:39,060 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:39,061 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:39,061 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:39,062 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:39,086 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:39,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:39,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:39,088 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:39,119 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. completed. 2023-07-12 08:14:39,119 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:39,119 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:39,119 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:39,119 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,119 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:39,119 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:14:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:39,122 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,122 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:39,125 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. completed. 2023-07-12 08:14:39,125 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:39,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,125 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:39,125 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:39,125 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,125 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:39,125 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:14:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,127 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,127 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:39,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,127 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,127 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43379,1689149646981': 2023-07-12 08:14:39,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:14:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:14:39,137 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:14:39,137 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-12 08:14:39,137 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:39,137 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:39,137 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,137 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,139 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,142 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,142 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,143 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,143 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,146 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,146 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,147 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,151 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,155 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,155 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,151 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,155 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 08:14:39,155 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:14:39,156 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,156 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,156 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,156 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,156 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,156 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 08:14:39,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,285 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 08:14:39,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,286 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:39,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689149678984Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689149679193 (+209 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689149679194 (+1 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689149679194Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689149679199 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689149679217 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689149679285 (+68 ms) 2023-07-12 08:14:39,288 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:39,289 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:39,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:39,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:39,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 307 msec 2023-07-12 08:14:39,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:39,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:39,313 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-12 08:14:39,314 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:39,314 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:39,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:39,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149679326 (current time:1689149679326). 2023-07-12 08:14:39,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:39,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x14b60f6f to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:39,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b6e7fa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:39,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:39,341 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:39,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14b60f6f to 127.0.0.1:55996 2023-07-12 08:14:39,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:39,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x74e9fe33 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:39,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63bafe7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:39,355 DEBUG [hconnection-0x6960b0c1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:39,356 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:39,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:39,365 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:39,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74e9fe33 to 127.0.0.1:55996 2023-07-12 08:14:39,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:39,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:14:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:39,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:39,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:39,376 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:39,380 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150279380 2023-07-12 08:14:39,380 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-12 08:14:39,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:14:39,380 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:39,381 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:39,384 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:14:39,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:39,385 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 11 msec 2023-07-12 08:14:39,386 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:39,387 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150279387 2023-07-12 08:14:39,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-12 08:14:39,420 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-12 08:14:39,420 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,422 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-12 08:14:39,422 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:14:39,423 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,423 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,425 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,425 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,425 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,425 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,426 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,426 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:39,427 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,427 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:39,427 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-12 08:14:39,427 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 08:14:39,428 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:39,435 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,434 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-12 08:14:39,433 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:39,440 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:39,440 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:39,438 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-12 08:14:39,440 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:39,440 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:39,440 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:39,441 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-12 08:14:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-12 08:14:39,442 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-12 08:14:39,444 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,444 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,445 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,445 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,446 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:39,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56626fc[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-12 08:14:39,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56626fc[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:39,457 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:14:39,457 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,459 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,459 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,459 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,460 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,460 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:39,460 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:39,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,460 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:39,460 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:14:39,460 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,460 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:39,460 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:39,460 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:39,460 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:39,460 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. started... 2023-07-12 08:14:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:14:39,461 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f3fd9f30c63daf1a47fcb2f7d598822e 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 08:14:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:39,461 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:39,461 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. started... 2023-07-12 08:14:39,461 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 26bbde77f04689ee3dffe3765eaf6432 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 08:14:39,462 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:39,462 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,462 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:39,481 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:39,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:39,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:39,482 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:39,490 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712b4c6c765c2694b6fa0dfe4c20065ee01 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712b4c6c765c2694b6fa0dfe4c20065ee01 2023-07-12 08:14:39,491 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712bf9413bbfc5a4c0bb2d0259b5ed423b9 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712bf9413bbfc5a4c0bb2d0259b5ed423b9 2023-07-12 08:14:39,516 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/.tmp/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64 2023-07-12 08:14:39,517 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/.tmp/cf/6723b6ee7e294fe18dca33cc853e0e44 2023-07-12 08:14:39,525 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/.tmp/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64 2023-07-12 08:14:39,527 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/.tmp/cf/6723b6ee7e294fe18dca33cc853e0e44 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf/6723b6ee7e294fe18dca33cc853e0e44 2023-07-12 08:14:39,533 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64, entries=46, sequenceid=6, filesize=12.7 K 2023-07-12 08:14:39,534 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for f3fd9f30c63daf1a47fcb2f7d598822e in 73ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:39,535 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-12 08:14:39,535 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf/6723b6ee7e294fe18dca33cc853e0e44, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 08:14:39,535 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f3fd9f30c63daf1a47fcb2f7d598822e: 2023-07-12 08:14:39,536 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:39,536 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:39,536 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64] hfiles 2023-07-12 08:14:39,536 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:39,536 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 26bbde77f04689ee3dffe3765eaf6432 in 75ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:39,538 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 26bbde77f04689ee3dffe3765eaf6432: 2023-07-12 08:14:39,538 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:39,538 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:39,538 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf/6723b6ee7e294fe18dca33cc853e0e44] hfiles 2023-07-12 08:14:39,538 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf/6723b6ee7e294fe18dca33cc853e0e44 for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:39,547 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. completed. 2023-07-12 08:14:39,547 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:39,547 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:39,547 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:39,547 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:14:39,548 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. completed. 2023-07-12 08:14:39,548 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-12 08:14:39,548 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:14:39,555 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:39,555 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,555 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,555 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:39,558 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,558 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-12 08:14:39,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,558 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,558 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-12 08:14:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43379,1689149646981': 2023-07-12 08:14:39,563 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:14:39,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:14:39,567 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:14:39,567 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-12 08:14:39,567 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:39,568 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:39,568 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-12 08:14:39,568 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:39,569 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,569 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,569 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:39,570 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,571 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,572 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:39,572 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-12 08:14:39,574 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,574 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,574 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-12 08:14:39,579 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-12 08:14:39,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-12 08:14:39,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:14:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,578 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:39,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:39,579 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,581 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712b4c6c765c2694b6fa0dfe4c20065ee01, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712bf9413bbfc5a4c0bb2d0259b5ed423b9] mob files 2023-07-12 08:14:39,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:39,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712b4c6c765c2694b6fa0dfe4c20065ee01 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:39,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712bf9413bbfc5a4c0bb2d0259b5ed423b9 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,582 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-12 08:14:39,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-12 08:14:39,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,644 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689149679380Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689149679592 (+212 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689149679592Loading Region manifests for snaptb0-testExportFileSystemState at 1689149679592Writing data manifest for snaptb0-testExportFileSystemState at 1689149679601 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689149679614 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689149679644 (+30 ms) 2023-07-12 08:14:39,647 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-12 08:14:39,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 265 msec 2023-07-12 08:14:39,682 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:39,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:14:39,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:39,684 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684 2023-07-12 08:14:39,684 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41579, tgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684, rawTgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:39,709 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:39,709 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1922052455_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,709 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-12 08:14:39,724 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-12 08:14:39,753 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:39,753 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:39,754 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:39,754 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,677 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-2173044025223335489.jar 2023-07-12 08:14:40,677 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,678 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,749 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-4113506645645230376.jar 2023-07-12 08:14:40,749 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,750 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,750 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,751 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,751 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,751 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:40,752 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:14:40,752 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:14:40,752 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:14:40,753 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:14:40,753 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:14:40,754 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:14:40,754 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:14:40,754 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:14:40,755 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:14:40,755 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:14:40,756 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:40,756 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:40,757 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:40,757 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:40,757 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:40,758 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:40,758 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:41,287 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:14:41,290 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-12 08:14:41,293 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-12 08:14:42,158 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:42,158 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:42,164 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0001_000001 (auth:SIMPLE) 2023-07-12 08:14:42,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:43,603 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:14:47,407 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:49,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:52,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:53,631 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:14:53,635 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:14:53,644 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-12 08:14:53,645 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:14:53,645 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:14:53,645 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 08:14:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 08:14:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 08:14:53,646 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-12 08:14:53,647 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-12 08:14:53,647 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149679684/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-12 08:14:53,657 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-12 08:14:53,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-12 08:14:53,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:53,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 08:14:53,663 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149693663"}]},"ts":"1689149693663"} 2023-07-12 08:14:53,665 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 08:14:53,666 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-12 08:14:53,667 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, UNASSIGN}] 2023-07-12 08:14:53,669 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, UNASSIGN 2023-07-12 08:14:53,669 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, UNASSIGN 2023-07-12 08:14:53,670 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f3fd9f30c63daf1a47fcb2f7d598822e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:53,670 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=26bbde77f04689ee3dffe3765eaf6432, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:53,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149693670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149693670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149693670"}]},"ts":"1689149693670"} 2023-07-12 08:14:53,671 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149693670"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149693670"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149693670"}]},"ts":"1689149693670"} 2023-07-12 08:14:53,672 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure f3fd9f30c63daf1a47fcb2f7d598822e, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:14:53,673 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 26bbde77f04689ee3dffe3765eaf6432, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:14:53,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 08:14:53,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f3fd9f30c63daf1a47fcb2f7d598822e, disabling compactions & flushes 2023-07-12 08:14:53,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. after waiting 0 ms 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:53,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 26bbde77f04689ee3dffe3765eaf6432, disabling compactions & flushes 2023-07-12 08:14:53,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. after waiting 0 ms 2023-07-12 08:14:53,826 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:53,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:53,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:14:53,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:53,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:14:53,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e. 2023-07-12 08:14:53,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432. 2023-07-12 08:14:53,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f3fd9f30c63daf1a47fcb2f7d598822e: 2023-07-12 08:14:53,844 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 26bbde77f04689ee3dffe3765eaf6432: 2023-07-12 08:14:53,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:53,847 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=26bbde77f04689ee3dffe3765eaf6432, regionState=CLOSED 2023-07-12 08:14:53,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:53,847 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149693847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149693847"}]},"ts":"1689149693847"} 2023-07-12 08:14:53,848 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=f3fd9f30c63daf1a47fcb2f7d598822e, regionState=CLOSED 2023-07-12 08:14:53,848 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689149693848"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149693848"}]},"ts":"1689149693848"} 2023-07-12 08:14:53,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-12 08:14:53,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 26bbde77f04689ee3dffe3765eaf6432, server=jenkins-hbase4.apache.org,39637,1689149647017 in 176 msec 2023-07-12 08:14:53,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-12 08:14:53,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure f3fd9f30c63daf1a47fcb2f7d598822e, server=jenkins-hbase4.apache.org,43379,1689149646981 in 178 msec 2023-07-12 08:14:53,853 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=26bbde77f04689ee3dffe3765eaf6432, UNASSIGN in 184 msec 2023-07-12 08:14:53,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-12 08:14:53,854 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=f3fd9f30c63daf1a47fcb2f7d598822e, UNASSIGN in 185 msec 2023-07-12 08:14:53,855 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149693855"}]},"ts":"1689149693855"} 2023-07-12 08:14:53,856 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 08:14:53,858 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-12 08:14:53,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 202 msec 2023-07-12 08:14:53,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-12 08:14:53,966 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-12 08:14:53,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-12 08:14:53,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:53,970 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:53,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-12 08:14:53,972 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:53,974 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-12 08:14:53,977 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:53,977 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:53,977 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,978 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,978 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,978 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:53,978 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:53,979 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,979 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:53,979 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,979 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:53,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-12 08:14:53,979 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/recovered.edits] 2023-07-12 08:14:53,979 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,980 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:53,979 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-12 08:14:53,980 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:53,979 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/recovered.edits] 2023-07-12 08:14:53,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 08:14:53,984 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf/6723b6ee7e294fe18dca33cc853e0e44 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/cf/6723b6ee7e294fe18dca33cc853e0e44 2023-07-12 08:14:53,984 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/cf/178fa5fd7c0f485b8d7ffb7fc99b0e64 2023-07-12 08:14:53,988 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432/recovered.edits/9.seqid 2023-07-12 08:14:53,988 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e/recovered.edits/9.seqid 2023-07-12 08:14:53,988 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/26bbde77f04689ee3dffe3765eaf6432 2023-07-12 08:14:53,988 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemState/f3fd9f30c63daf1a47fcb2f7d598822e 2023-07-12 08:14:53,989 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-12 08:14:53,989 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 08:14:53,990 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-12 08:14:53,994 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712b4c6c765c2694b6fa0dfe4c20065ee01 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230712b4c6c765c2694b6fa0dfe4c20065ee01 2023-07-12 08:14:53,995 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712bf9413bbfc5a4c0bb2d0259b5ed423b9 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230712bf9413bbfc5a4c0bb2d0259b5ed423b9 2023-07-12 08:14:53,995 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-12 08:14:53,998 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:54,000 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-12 08:14:54,002 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-12 08:14:54,004 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:54,004 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-12 08:14:54,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149694004"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:54,004 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149694004"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:54,006 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:14:54,006 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 26bbde77f04689ee3dffe3765eaf6432, NAME => 'testtb-testExportFileSystemState,,1689149678282.26bbde77f04689ee3dffe3765eaf6432.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f3fd9f30c63daf1a47fcb2f7d598822e, NAME => 'testtb-testExportFileSystemState,1,1689149678282.f3fd9f30c63daf1a47fcb2f7d598822e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:14:54,006 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-12 08:14:54,006 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149694006"}]},"ts":"9223372036854775807"} 2023-07-12 08:14:54,008 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-12 08:14:54,009 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-12 08:14:54,011 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 43 msec 2023-07-12 08:14:54,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-12 08:14:54,082 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-12 08:14:54,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-12 08:14:54,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-12 08:14:54,092 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-12 08:14:54,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-12 08:14:54,119 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-475371173_1 at /127.0.0.1:47996 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2147 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:55870 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:44945 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:36268 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:48024 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=396 (was 370) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=3321 (was 3414) 2023-07-12 08:14:54,119 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 08:14:54,139 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=396, ProcessCount=179, AvailableMemoryMB=3320 2023-07-12 08:14:54,139 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-12 08:14:54,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 08:14:54,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:14:54,143 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:14:54,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-12 08:14:54,144 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:14:54,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:54,147 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,147 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,148 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 empty. 2023-07-12 08:14:54,148 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 empty. 2023-07-12 08:14:54,148 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,148 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,148 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 08:14:54,160 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-12 08:14:54,162 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => bdc61df154cedf19d9d4987c6a9f0211, NAME => 'testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:54,163 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3afa175ee387de9f4f604e07fefb1931, NAME => 'testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:14:54,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:54,189 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing bdc61df154cedf19d9d4987c6a9f0211, disabling compactions & flushes 2023-07-12 08:14:54,190 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. after waiting 0 ms 2023-07-12 08:14:54,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,190 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,190 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for bdc61df154cedf19d9d4987c6a9f0211: 2023-07-12 08:14:54,191 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:54,191 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 3afa175ee387de9f4f604e07fefb1931, disabling compactions & flushes 2023-07-12 08:14:54,191 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,191 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,191 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. after waiting 0 ms 2023-07-12 08:14:54,191 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,191 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,191 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 3afa175ee387de9f4f604e07fefb1931: 2023-07-12 08:14:54,194 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:14:54,195 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149694195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149694195"}]},"ts":"1689149694195"} 2023-07-12 08:14:54,195 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149694195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149694195"}]},"ts":"1689149694195"} 2023-07-12 08:14:54,197 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:14:54,198 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:14:54,198 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149694198"}]},"ts":"1689149694198"} 2023-07-12 08:14:54,200 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-12 08:14:54,204 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:14:54,205 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:14:54,206 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:14:54,206 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:14:54,206 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:14:54,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, ASSIGN}] 2023-07-12 08:14:54,211 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, ASSIGN 2023-07-12 08:14:54,211 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, ASSIGN 2023-07-12 08:14:54,212 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:14:54,212 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689149646981; forceNewPlan=false, retain=false 2023-07-12 08:14:54,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:54,362 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:14:54,365 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3afa175ee387de9f4f604e07fefb1931, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,365 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=bdc61df154cedf19d9d4987c6a9f0211, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,365 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149694365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149694365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149694365"}]},"ts":"1689149694365"} 2023-07-12 08:14:54,365 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149694365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149694365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149694365"}]},"ts":"1689149694365"} 2023-07-12 08:14:54,367 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 3afa175ee387de9f4f604e07fefb1931, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:14:54,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure bdc61df154cedf19d9d4987c6a9f0211, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:14:54,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:54,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3afa175ee387de9f4f604e07fefb1931, NAME => 'testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:14:54,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. service=AccessControlService 2023-07-12 08:14:54,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:54,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bdc61df154cedf19d9d4987c6a9f0211, NAME => 'testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:14:54,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. service=AccessControlService 2023-07-12 08:14:54,528 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,528 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,529 INFO [StoreOpener-3afa175ee387de9f4f604e07fefb1931-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,530 INFO [StoreOpener-bdc61df154cedf19d9d4987c6a9f0211-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,531 DEBUG [StoreOpener-3afa175ee387de9f4f604e07fefb1931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf 2023-07-12 08:14:54,531 DEBUG [StoreOpener-3afa175ee387de9f4f604e07fefb1931-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf 2023-07-12 08:14:54,531 DEBUG [StoreOpener-bdc61df154cedf19d9d4987c6a9f0211-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf 2023-07-12 08:14:54,531 DEBUG [StoreOpener-bdc61df154cedf19d9d4987c6a9f0211-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf 2023-07-12 08:14:54,531 INFO [StoreOpener-3afa175ee387de9f4f604e07fefb1931-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3afa175ee387de9f4f604e07fefb1931 columnFamilyName cf 2023-07-12 08:14:54,532 INFO [StoreOpener-bdc61df154cedf19d9d4987c6a9f0211-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bdc61df154cedf19d9d4987c6a9f0211 columnFamilyName cf 2023-07-12 08:14:54,533 INFO [StoreOpener-3afa175ee387de9f4f604e07fefb1931-1] regionserver.HStore(310): Store=3afa175ee387de9f4f604e07fefb1931/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:54,533 INFO [StoreOpener-bdc61df154cedf19d9d4987c6a9f0211-1] regionserver.HStore(310): Store=bdc61df154cedf19d9d4987c6a9f0211/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:14:54,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:14:54,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:14:54,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:54,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:14:54,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bdc61df154cedf19d9d4987c6a9f0211; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68626224, jitterRate=0.02261042594909668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:54,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bdc61df154cedf19d9d4987c6a9f0211: 2023-07-12 08:14:54,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3afa175ee387de9f4f604e07fefb1931; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67596806, jitterRate=0.007270902395248413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:14:54,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3afa175ee387de9f4f604e07fefb1931: 2023-07-12 08:14:54,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931., pid=45, masterSystemTime=1689149694520 2023-07-12 08:14:54,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211., pid=46, masterSystemTime=1689149694521 2023-07-12 08:14:54,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,543 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=3afa175ee387de9f4f604e07fefb1931, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,544 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149694543"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149694543"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149694543"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149694543"}]},"ts":"1689149694543"} 2023-07-12 08:14:54,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=bdc61df154cedf19d9d4987c6a9f0211, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149694544"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149694544"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149694544"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149694544"}]},"ts":"1689149694544"} 2023-07-12 08:14:54,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-12 08:14:54,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 3afa175ee387de9f4f604e07fefb1931, server=jenkins-hbase4.apache.org,43379,1689149646981 in 179 msec 2023-07-12 08:14:54,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-12 08:14:54,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure bdc61df154cedf19d9d4987c6a9f0211, server=jenkins-hbase4.apache.org,40943,1689149646919 in 179 msec 2023-07-12 08:14:54,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, ASSIGN in 343 msec 2023-07-12 08:14:54,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-12 08:14:54,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, ASSIGN in 344 msec 2023-07-12 08:14:54,554 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:14:54,554 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149694554"}]},"ts":"1689149694554"} 2023-07-12 08:14:54,555 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-12 08:14:54,558 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:14:54,558 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-12 08:14:54,560 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 08:14:54,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:54,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:54,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:54,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:14:54,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:54,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:54,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:54,564 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-12 08:14:54,565 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 423 msec 2023-07-12 08:14:54,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-12 08:14:54,748 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-12 08:14:54,751 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 08:14:54,752 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,753 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:54,770 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:54,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149694770 (current time:1689149694770). 2023-07-12 08:14:54,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:54,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x3df1f93e to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:54,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3dd64d96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:54,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:54,787 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46860, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:54,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3df1f93e to 127.0.0.1:55996 2023-07-12 08:14:54,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:54,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x59cf7ba1 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:54,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b4551af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:54,798 DEBUG [hconnection-0x64f01bac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:54,805 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:54,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:54,817 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:54,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59cf7ba1 to 127.0.0.1:55996 2023-07-12 08:14:54,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:54,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 08:14:54,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:54,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:54,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:54,823 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:54,824 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689150294824 2023-07-12 08:14:54,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 08:14:54,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:54,826 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:54,826 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:54,827 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:54,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:54,835 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-07-12 08:14:54,836 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:54,837 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689150294837 2023-07-12 08:14:54,851 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,852 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-12 08:14:54,852 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:54,853 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 08:14:54,853 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 08:14:54,854 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,854 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:54,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:54,856 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:54,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:54,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:54,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:54,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:54,857 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,857 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,857 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,857 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:54,858 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:54,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,863 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:54,863 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:54,869 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,871 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,870 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:54,871 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:54,872 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:54,873 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:54,879 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:54,880 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,880 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:54,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:54,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:54,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149d15f3[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:54,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:54,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:54,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:54,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:54,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@149d15f3[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:54,886 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 08:14:54,886 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:54,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,887 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:54,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:54,888 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:54,888 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. started... 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:54,888 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,888 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,888 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:54,889 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bdc61df154cedf19d9d4987c6a9f0211: 2023-07-12 08:14:54,888 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. started... 2023-07-12 08:14:54,888 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:54,890 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3afa175ee387de9f4f604e07fefb1931: 2023-07-12 08:14:54,890 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,891 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:54,891 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,892 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:54,892 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:54,892 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:14:54,895 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:54,895 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:54,895 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:54,926 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:54,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:54,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:54,937 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:54,937 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. completed. 2023-07-12 08:14:54,937 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:54,937 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:54,937 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:54,937 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,937 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:54,937 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:14:54,939 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:54,939 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,939 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:54,939 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:54,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:54,941 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. completed. 2023-07-12 08:14:54,941 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:54,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:54,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:54,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:54,941 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:14:54,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:54,943 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:54,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,943 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:54,943 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,943 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:54,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:14:54,949 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 08:14:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43379,1689149646981': 2023-07-12 08:14:54,954 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 08:14:54,954 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-12 08:14:54,955 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:54,955 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:54,955 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,955 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:54,957 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:54,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:54,957 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,957 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:54,958 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:54,958 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,959 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:54,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,961 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,961 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,962 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,962 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,966 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,966 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:54,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:54,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,967 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:54,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,967 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,967 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:54,968 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 08:14:54,967 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:54,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,969 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,969 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:14:54,970 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:54,970 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:54,970 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,970 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:54,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:54,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:54,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 08:14:54,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-12 08:14:54,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:54,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:55,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:55,055 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 08:14:55,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:55,056 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-12 08:14:55,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689149694824Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689149694985 (+161 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689149694985Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689149694985Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689149694990 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689149695001 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689149695055 (+54 ms) 2023-07-12 08:14:55,059 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:55,061 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 234 msec 2023-07-12 08:14:55,137 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:55,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:55,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:55,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:55,142 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43379] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:14:55,145 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-12 08:14:55,145 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:55,145 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:14:55,155 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:55,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149695155 (current time:1689149695155). 2023-07-12 08:14:55,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:14:55,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x0d401566 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:55,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e66cfa9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:55,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:55,169 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:55,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d401566 to 127.0.0.1:55996 2023-07-12 08:14:55,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:55,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x207c9556 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:14:55,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d9a4f1a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:14:55,178 DEBUG [hconnection-0x15b9c687-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:55,180 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:55,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:14:55,184 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:14:55,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x207c9556 to 127.0.0.1:55996 2023-07-12 08:14:55,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:14:55,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-12 08:14:55,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:14:55,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:55,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:55,189 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:55,190 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689150295190 2023-07-12 08:14:55,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-12 08:14:55,190 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-12 08:14:55,191 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:14:55,192 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:14:55,193 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-12 08:14:55,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:55,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-12 08:14:55,195 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:55,195 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689150295195 2023-07-12 08:14:55,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-12 08:14:55,207 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-12 08:14:55,207 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:55,208 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-12 08:14:55,208 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-12 08:14:55,208 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,208 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,209 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:55,209 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:55,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:55,209 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:55,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:55,209 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,210 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,210 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,211 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,211 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-12 08:14:55,211 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:55,212 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 08:14:55,212 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:55,212 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:55,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:55,213 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:55,213 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-12 08:14:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:55,214 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-12 08:14:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-12 08:14:55,214 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:14:55,215 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-12 08:14:55,215 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-12 08:14:55,215 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-12 08:14:55,216 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,216 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:55,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:55,218 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:55,218 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,218 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:55,221 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,222 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,222 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:14:55,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6ee1ac[Count = 1] remaining members to acquire global barrier 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:55,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:55,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-12 08:14:55,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c6ee1ac[Count = 0] remaining members to acquire global barrier 2023-07-12 08:14:55,229 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-12 08:14:55,229 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-12 08:14:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:14:55,231 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,232 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:14:55,231 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:55,232 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:14:55,232 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. started... 2023-07-12 08:14:55,232 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:14:55,232 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:55,232 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bdc61df154cedf19d9d4987c6a9f0211 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 08:14:55,232 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. started... 2023-07-12 08:14:55,232 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3afa175ee387de9f4f604e07fefb1931 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 08:14:55,233 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:55,233 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:55,233 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:55,274 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071298706ae3269f44dd96cedacf097e3e2a to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071298706ae3269f44dd96cedacf097e3e2a 2023-07-12 08:14:55,274 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712c038cd4dacb848048d6e45b3429ce244 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712c038cd4dacb848048d6e45b3429ce244 2023-07-12 08:14:55,292 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:55,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:55,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:14:55,295 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:14:55,295 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/.tmp/cf/42930ed1f07649e780c4c359d2d9af49 2023-07-12 08:14:55,296 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/.tmp/cf/058801bfd18844d588a610fb10c43f68 2023-07-12 08:14:55,301 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/.tmp/cf/42930ed1f07649e780c4c359d2d9af49 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf/42930ed1f07649e780c4c359d2d9af49 2023-07-12 08:14:55,302 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/.tmp/cf/058801bfd18844d588a610fb10c43f68 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf/058801bfd18844d588a610fb10c43f68 2023-07-12 08:14:55,307 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf/058801bfd18844d588a610fb10c43f68, entries=47, sequenceid=6, filesize=12.7 K 2023-07-12 08:14:55,308 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf/42930ed1f07649e780c4c359d2d9af49, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 08:14:55,308 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3afa175ee387de9f4f604e07fefb1931 in 76ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:55,308 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-12 08:14:55,309 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for bdc61df154cedf19d9d4987c6a9f0211 in 77ms, sequenceid=6, compaction requested=false 2023-07-12 08:14:55,309 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3afa175ee387de9f4f604e07fefb1931: 2023-07-12 08:14:55,310 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bdc61df154cedf19d9d4987c6a9f0211: 2023-07-12 08:14:55,310 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:55,310 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:55,310 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:55,310 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf/058801bfd18844d588a610fb10c43f68] hfiles 2023-07-12 08:14:55,310 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:14:55,311 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf/058801bfd18844d588a610fb10c43f68 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:55,311 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf/42930ed1f07649e780c4c359d2d9af49] hfiles 2023-07-12 08:14:55,311 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf/42930ed1f07649e780c4c359d2d9af49 for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:55,321 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. completed. 2023-07-12 08:14:55,321 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:55,321 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. completed. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:14:55,321 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:14:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-12 08:14:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:14:55,323 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:55,323 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:55,323 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,323 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:55,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-12 08:14:55,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:55,325 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:55,325 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-12 08:14:55,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:14:55,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-12 08:14:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:55,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43379,1689149646981': 2023-07-12 08:14:55,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-12 08:14:55,332 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-12 08:14:55,332 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:14:55,332 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:14:55,332 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-12 08:14:55,333 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:14:55,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,334 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,335 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:14:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:55,336 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,336 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:14:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,338 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:14:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-12 08:14:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,339 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,340 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,346 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:55,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:55,347 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:14:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:55,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:55,347 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-12 08:14:55,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:14:55,349 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-12 08:14:55,347 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:14:55,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:14:55,349 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-12 08:14:55,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:55,350 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:14:55,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:14:55,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:14:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:14:55,350 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,350 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:14:55,350 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:14:55,350 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,350 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071298706ae3269f44dd96cedacf097e3e2a, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712c038cd4dacb848048d6e45b3429ce244] mob files 2023-07-12 08:14:55,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071298706ae3269f44dd96cedacf097e3e2a 2023-07-12 08:14:55,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712c038cd4dacb848048d6e45b3429ce244 2023-07-12 08:14:55,361 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-12 08:14:55,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-12 08:14:55,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,412 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689149695190Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689149695361 (+171 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689149695361Loading Region manifests for snaptb0-testConsecutiveExports at 1689149695361Writing data manifest for snaptb0-testConsecutiveExports at 1689149695365 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689149695377 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689149695412 (+35 ms) 2023-07-12 08:14:55,414 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-12 08:14:55,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 223 msec 2023-07-12 08:14:55,495 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:14:55,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-12 08:14:55,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:14:55,496 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496 2023-07-12 08:14:55,497 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:55,519 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:14:55,519 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5597ab58, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,519 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 08:14:55,528 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:14:55,540 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:55,540 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:55,541 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:55,541 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,430 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-3442068286698817550.jar 2023-07-12 08:14:56,431 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,431 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,498 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-4427868773161606393.jar 2023-07-12 08:14:56,498 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,499 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,499 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,500 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,500 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,500 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:14:56,501 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:14:56,502 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:14:56,502 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:14:56,503 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:14:56,503 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:14:56,504 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:14:56,505 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:14:56,505 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:14:56,506 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:14:56,506 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:14:56,507 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:56,508 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:56,509 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:56,509 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:56,509 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:14:56,510 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:56,510 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:14:57,328 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:14:57,331 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 08:14:57,333 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 08:14:58,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:58,606 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:14:58,610 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0002_000001 (auth:SIMPLE) 2023-07-12 08:14:59,180 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0003_000001 (auth:SIMPLE) 2023-07-12 08:14:59,455 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:03,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:05,843 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:08,257 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:09,515 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:15:09,516 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:15:09,525 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 08:15:09,525 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:15:09,526 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:15:09,526 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:09,528 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:09,528 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:09,528 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@160bb0c7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:09,529 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:09,529 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:09,530 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:15:09,555 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:15:09,555 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7f6a44eb, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:15:09,555 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-12 08:15:09,570 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-12 08:15:09,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:09,586 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,504 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-4702838121101304525.jar 2023-07-12 08:15:10,505 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,505 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,572 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-2306205237024083541.jar 2023-07-12 08:15:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,573 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,574 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:15:10,575 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:15:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:15:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:15:10,576 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:15:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:15:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:15:10,577 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:15:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:15:10,578 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:15:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:10,579 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:10,580 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:10,580 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:10,580 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:10,581 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:10,581 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:11,007 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:15:11,009 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-12 08:15:11,011 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-12 08:15:14,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:14,431 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:14,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0003_000001 (auth:SIMPLE) 2023-07-12 08:15:14,622 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:19,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:21,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:27,212 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:15:27,213 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:15:27,251 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-12 08:15:27,252 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:15:27,252 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:15:27,252 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@160bb0c7 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-12 08:15:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-12 08:15:27,263 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/local-export-1689149695496/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-12 08:15:27,277 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-12 08:15:27,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-12 08:15:27,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:27,284 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149727284"}]},"ts":"1689149727284"} 2023-07-12 08:15:27,286 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-12 08:15:27,290 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-12 08:15:27,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, UNASSIGN}] 2023-07-12 08:15:27,294 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, UNASSIGN 2023-07-12 08:15:27,294 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, UNASSIGN 2023-07-12 08:15:27,300 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3afa175ee387de9f4f604e07fefb1931, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:27,300 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=bdc61df154cedf19d9d4987c6a9f0211, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:27,300 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149727300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149727300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149727300"}]},"ts":"1689149727300"} 2023-07-12 08:15:27,300 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149727300"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149727300"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149727300"}]},"ts":"1689149727300"} 2023-07-12 08:15:27,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 3afa175ee387de9f4f604e07fefb1931, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:15:27,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure bdc61df154cedf19d9d4987c6a9f0211, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:15:27,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:27,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:15:27,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3afa175ee387de9f4f604e07fefb1931, disabling compactions & flushes 2023-07-12 08:15:27,466 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:15:27,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:15:27,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. after waiting 0 ms 2023-07-12 08:15:27,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:15:27,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:15:27,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bdc61df154cedf19d9d4987c6a9f0211, disabling compactions & flushes 2023-07-12 08:15:27,467 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:15:27,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:15:27,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. after waiting 0 ms 2023-07-12 08:15:27,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:15:27,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:27,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:27,516 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211. 2023-07-12 08:15:27,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bdc61df154cedf19d9d4987c6a9f0211: 2023-07-12 08:15:27,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:27,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:27,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931. 2023-07-12 08:15:27,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3afa175ee387de9f4f604e07fefb1931: 2023-07-12 08:15:27,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:15:27,522 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=bdc61df154cedf19d9d4987c6a9f0211, regionState=CLOSED 2023-07-12 08:15:27,522 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149727522"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149727522"}]},"ts":"1689149727522"} 2023-07-12 08:15:27,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:15:27,527 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=3afa175ee387de9f4f604e07fefb1931, regionState=CLOSED 2023-07-12 08:15:27,528 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689149727527"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149727527"}]},"ts":"1689149727527"} 2023-07-12 08:15:27,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-12 08:15:27,535 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure bdc61df154cedf19d9d4987c6a9f0211, server=jenkins-hbase4.apache.org,40943,1689149646919 in 214 msec 2023-07-12 08:15:27,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-12 08:15:27,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 3afa175ee387de9f4f604e07fefb1931, server=jenkins-hbase4.apache.org,43379,1689149646981 in 217 msec 2023-07-12 08:15:27,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bdc61df154cedf19d9d4987c6a9f0211, UNASSIGN in 244 msec 2023-07-12 08:15:27,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-12 08:15:27,538 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=3afa175ee387de9f4f604e07fefb1931, UNASSIGN in 245 msec 2023-07-12 08:15:27,538 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149727538"}]},"ts":"1689149727538"} 2023-07-12 08:15:27,540 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-12 08:15:27,541 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-12 08:15:27,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 264 msec 2023-07-12 08:15:27,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-12 08:15:27,587 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-12 08:15:27,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-12 08:15:27,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,592 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-12 08:15:27,593 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,596 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-12 08:15:27,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,599 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 08:15:27,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 08:15:27,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 08:15:27,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,602 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:27,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 08:15:27,606 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:15:27,607 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:15:27,611 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/recovered.edits] 2023-07-12 08:15:27,611 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/recovered.edits] 2023-07-12 08:15:27,617 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf/058801bfd18844d588a610fb10c43f68 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/cf/058801bfd18844d588a610fb10c43f68 2023-07-12 08:15:27,617 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf/42930ed1f07649e780c4c359d2d9af49 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/cf/42930ed1f07649e780c4c359d2d9af49 2023-07-12 08:15:27,621 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931/recovered.edits/9.seqid 2023-07-12 08:15:27,622 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211/recovered.edits/9.seqid 2023-07-12 08:15:27,622 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/3afa175ee387de9f4f604e07fefb1931 2023-07-12 08:15:27,622 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testConsecutiveExports/bdc61df154cedf19d9d4987c6a9f0211 2023-07-12 08:15:27,622 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-12 08:15:27,623 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 08:15:27,624 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-12 08:15:27,628 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071298706ae3269f44dd96cedacf097e3e2a to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023071298706ae3269f44dd96cedacf097e3e2a 2023-07-12 08:15:27,629 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712c038cd4dacb848048d6e45b3429ce244 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230712c038cd4dacb848048d6e45b3429ce244 2023-07-12 08:15:27,630 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-12 08:15:27,632 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,638 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-12 08:15:27,646 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-12 08:15:27,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,647 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-12 08:15:27,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149727647"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:27,647 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149727647"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:27,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:15:27,652 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bdc61df154cedf19d9d4987c6a9f0211, NAME => 'testtb-testConsecutiveExports,,1689149694140.bdc61df154cedf19d9d4987c6a9f0211.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3afa175ee387de9f4f604e07fefb1931, NAME => 'testtb-testConsecutiveExports,1,1689149694140.3afa175ee387de9f4f604e07fefb1931.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:15:27,652 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-12 08:15:27,652 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149727652"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:27,654 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-12 08:15:27,656 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-12 08:15:27,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 69 msec 2023-07-12 08:15:27,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-12 08:15:27,705 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-12 08:15:27,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-12 08:15:27,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-12 08:15:27,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-12 08:15:27,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-12 08:15:27,774 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 763), OpenFileDescriptor=901 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=455 (was 396) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=3152 (was 3320) 2023-07-12 08:15:27,774 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 08:15:27,817 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=455, ProcessCount=180, AvailableMemoryMB=3105 2023-07-12 08:15:27,817 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-12 08:15:27,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 08:15:27,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:27,827 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:15:27,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-12 08:15:27,828 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:15:27,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:27,836 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:27,837 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d empty. 2023-07-12 08:15:27,837 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:27,838 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:27,839 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef empty. 2023-07-12 08:15:27,840 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:27,840 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 08:15:27,892 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-12 08:15:27,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b31d2191d052f69a70ef5bf948a0012d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:15:27,899 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6ee5c2dcd3ab83de5bec770032fe40ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:15:27,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:27,974 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:27,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 6ee5c2dcd3ab83de5bec770032fe40ef, disabling compactions & flushes 2023-07-12 08:15:27,975 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:27,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:27,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. after waiting 0 ms 2023-07-12 08:15:27,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:27,975 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:27,975 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 6ee5c2dcd3ab83de5bec770032fe40ef: 2023-07-12 08:15:27,980 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:27,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b31d2191d052f69a70ef5bf948a0012d, disabling compactions & flushes 2023-07-12 08:15:27,981 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:27,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:27,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. after waiting 0 ms 2023-07-12 08:15:27,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:27,981 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:27,981 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b31d2191d052f69a70ef5bf948a0012d: 2023-07-12 08:15:27,984 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:15:27,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149727985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149727985"}]},"ts":"1689149727985"} 2023-07-12 08:15:27,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149727985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149727985"}]},"ts":"1689149727985"} 2023-07-12 08:15:28,007 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:15:28,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:15:28,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149728009"}]},"ts":"1689149728009"} 2023-07-12 08:15:28,011 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-12 08:15:28,016 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:15:28,017 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:15:28,018 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:15:28,018 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:15:28,018 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:15:28,018 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, ASSIGN}] 2023-07-12 08:15:28,022 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, ASSIGN 2023-07-12 08:15:28,022 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, ASSIGN 2023-07-12 08:15:28,023 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43379,1689149646981; forceNewPlan=false, retain=false 2023-07-12 08:15:28,023 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:15:28,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:28,173 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:15:28,180 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b31d2191d052f69a70ef5bf948a0012d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,180 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149728180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149728180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149728180"}]},"ts":"1689149728180"} 2023-07-12 08:15:28,181 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=6ee5c2dcd3ab83de5bec770032fe40ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,181 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149728181"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149728181"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149728181"}]},"ts":"1689149728181"} 2023-07-12 08:15:28,184 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure b31d2191d052f69a70ef5bf948a0012d, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:15:28,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 6ee5c2dcd3ab83de5bec770032fe40ef, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:15:28,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:28,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b31d2191d052f69a70ef5bf948a0012d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:15:28,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:28,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. service=AccessControlService 2023-07-12 08:15:28,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6ee5c2dcd3ab83de5bec770032fe40ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:15:28,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. service=AccessControlService 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,349 INFO [StoreOpener-6ee5c2dcd3ab83de5bec770032fe40ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,349 INFO [StoreOpener-b31d2191d052f69a70ef5bf948a0012d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,351 DEBUG [StoreOpener-6ee5c2dcd3ab83de5bec770032fe40ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf 2023-07-12 08:15:28,351 DEBUG [StoreOpener-b31d2191d052f69a70ef5bf948a0012d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf 2023-07-12 08:15:28,351 DEBUG [StoreOpener-6ee5c2dcd3ab83de5bec770032fe40ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf 2023-07-12 08:15:28,351 DEBUG [StoreOpener-b31d2191d052f69a70ef5bf948a0012d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf 2023-07-12 08:15:28,353 INFO [StoreOpener-6ee5c2dcd3ab83de5bec770032fe40ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6ee5c2dcd3ab83de5bec770032fe40ef columnFamilyName cf 2023-07-12 08:15:28,353 INFO [StoreOpener-b31d2191d052f69a70ef5bf948a0012d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b31d2191d052f69a70ef5bf948a0012d columnFamilyName cf 2023-07-12 08:15:28,354 INFO [StoreOpener-b31d2191d052f69a70ef5bf948a0012d-1] regionserver.HStore(310): Store=b31d2191d052f69a70ef5bf948a0012d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:28,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,356 INFO [StoreOpener-6ee5c2dcd3ab83de5bec770032fe40ef-1] regionserver.HStore(310): Store=6ee5c2dcd3ab83de5bec770032fe40ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:28,357 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,358 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:28,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:28,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:28,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:28,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b31d2191d052f69a70ef5bf948a0012d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68889381, jitterRate=0.026531770825386047}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:28,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b31d2191d052f69a70ef5bf948a0012d: 2023-07-12 08:15:28,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6ee5c2dcd3ab83de5bec770032fe40ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68549548, jitterRate=0.021467864513397217}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:28,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6ee5c2dcd3ab83de5bec770032fe40ef: 2023-07-12 08:15:28,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d., pid=60, masterSystemTime=1689149728341 2023-07-12 08:15:28,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef., pid=61, masterSystemTime=1689149728341 2023-07-12 08:15:28,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:28,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:28,386 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b31d2191d052f69a70ef5bf948a0012d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:28,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:28,386 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149728386"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149728386"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149728386"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149728386"}]},"ts":"1689149728386"} 2023-07-12 08:15:28,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=6ee5c2dcd3ab83de5bec770032fe40ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149728387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149728387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149728387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149728387"}]},"ts":"1689149728387"} 2023-07-12 08:15:28,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-12 08:15:28,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure b31d2191d052f69a70ef5bf948a0012d, server=jenkins-hbase4.apache.org,43379,1689149646981 in 205 msec 2023-07-12 08:15:28,401 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-12 08:15:28,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 6ee5c2dcd3ab83de5bec770032fe40ef, server=jenkins-hbase4.apache.org,40943,1689149646919 in 211 msec 2023-07-12 08:15:28,402 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, ASSIGN in 381 msec 2023-07-12 08:15:28,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-12 08:15:28,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, ASSIGN in 384 msec 2023-07-12 08:15:28,414 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:15:28,414 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149728414"}]},"ts":"1689149728414"} 2023-07-12 08:15:28,416 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-12 08:15:28,419 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:15:28,420 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-12 08:15:28,422 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 08:15:28,424 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:28,424 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:28,424 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:28,424 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:28,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:28,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:28,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:28,426 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:28,429 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 606 msec 2023-07-12 08:15:28,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-12 08:15:28,434 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-12 08:15:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,448 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:28,450 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:28,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:28,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149728507 (current time:1689149728507). 2023-07-12 08:15:28,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:28,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x686d4a66 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:28,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d253c9c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:28,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:28,524 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:28,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x686d4a66 to 127.0.0.1:55996 2023-07-12 08:15:28,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:28,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x2f156c83 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:28,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d292d7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:28,571 DEBUG [hconnection-0x69ac3598-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:28,572 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:28,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:28,581 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56140, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:28,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f156c83 to 127.0.0.1:55996 2023-07-12 08:15:28,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:28,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 08:15:28,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:28,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:28,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:28,591 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:28,592 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689150328592 2023-07-12 08:15:28,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:28,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,593 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:28,593 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:28,597 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:28,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:28,605 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-12 08:15:28,611 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:28,624 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689150328624 2023-07-12 08:15:28,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,671 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 08:15:28,671 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:28,673 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 08:15:28,673 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 08:15:28,673 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,673 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,676 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:28,676 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:28,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:28,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:28,676 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:28,676 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:28,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:28,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,682 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,682 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,683 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,683 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,683 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:28,683 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:28,683 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:28,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-12 08:15:28,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:28,685 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:28,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,685 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:28,686 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:28,686 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:28,687 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:28,688 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:28,689 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:28,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:28,691 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,693 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,695 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,695 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:28,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:28,699 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,700 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:28,700 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:28,701 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,701 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:28,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:28,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa76fe9[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:28,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:28,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:28,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:28,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7fa76fe9[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:28,707 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 08:15:28,707 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,708 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,708 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,708 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,709 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,709 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:28,709 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:28,709 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:28,709 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:15:28,709 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:28,716 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:28,716 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:28,715 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:28,718 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:28,715 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,718 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:28,718 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. started... 2023-07-12 08:15:28,716 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. started... 2023-07-12 08:15:28,716 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:28,719 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ee5c2dcd3ab83de5bec770032fe40ef: 2023-07-12 08:15:28,720 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b31d2191d052f69a70ef5bf948a0012d: 2023-07-12 08:15:28,721 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,721 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:28,721 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,721 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:28,721 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:28,721 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:28,802 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. completed. 2023-07-12 08:15:28,802 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:28,802 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:28,802 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:28,802 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,803 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:28,803 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:15:28,805 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,805 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:28,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:28,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:28,805 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:28,805 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:28,807 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. completed. 2023-07-12 08:15:28,807 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:28,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:28,807 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:15:28,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:28,810 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:28,810 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,810 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:28,810 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:28,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:15:28,816 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 08:15:28,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:28,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:28,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:28,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:28,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43379,1689149646981': 2023-07-12 08:15:28,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 08:15:28,824 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 08:15:28,824 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:28,824 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:28,824 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,824 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:28,827 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,827 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:28,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,827 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,828 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:28,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,831 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,831 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:28,831 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:28,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:28,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:28,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:28,832 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:28,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:28,833 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:28,833 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,837 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:28,837 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,838 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:28,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:28,844 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:28,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:28,844 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:28,845 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:28,845 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,845 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:28,844 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:28,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:28,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 08:15:28,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:28,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:28,843 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:28,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:28,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:28,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:28,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:28,895 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:28,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:28,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:28,897 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:29,197 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:29,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:29,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:29,199 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:15:29,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 08:15:29,444 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,445 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689149728593Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689149729286 (+693 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149729286Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149729286Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149729312 (+26 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689149729362 (+50 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689149729444 (+82 ms) 2023-07-12 08:15:29,448 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:29,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 852 msec 2023-07-12 08:15:29,700 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:29,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:29,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:29,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:29,706 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43379] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:29,709 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,709 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:29,709 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:29,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:29,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149729721 (current time:1689149729721). 2023-07-12 08:15:29,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:29,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x75e9022f to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:29,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b847daf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:29,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:29,738 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:29,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75e9022f to 127.0.0.1:55996 2023-07-12 08:15:29,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:29,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x2bd6ffeb to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:29,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@161378c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:29,751 DEBUG [hconnection-0x4e2216ac-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:29,755 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:29,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:29,763 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:29,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2bd6ffeb to 127.0.0.1:55996 2023-07-12 08:15:29,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:29,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-12 08:15:29,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:29,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:29,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:29,769 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:29,770 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689150329770 2023-07-12 08:15:29,770 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-12 08:15:29,772 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:29,772 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:29,773 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:29,773 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-12 08:15:29,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-12 08:15:29,775 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:29,776 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689150329776 2023-07-12 08:15:29,806 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,807 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-12 08:15:29,807 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,809 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-12 08:15:29,809 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-12 08:15:29,809 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,809 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,810 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,810 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,811 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,810 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:29,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:29,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,813 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,813 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,813 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,814 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,814 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 08:15:29,814 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,814 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:29,814 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,815 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:29,815 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,816 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:29,816 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:29,816 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:29,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 08:15:29,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:29,817 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-12 08:15:29,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:29,818 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-12 08:15:29,818 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,823 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:29,823 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,823 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:29,823 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-12 08:15:29,823 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:29,823 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-12 08:15:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-12 08:15:29,824 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-12 08:15:29,825 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,825 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,825 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:29,827 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,827 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:29,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:29,827 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:29,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,828 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b42f727[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:29,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:29,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:29,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-12 08:15:29,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b42f727[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:29,837 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-12 08:15:29,837 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,838 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-12 08:15:29,838 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:29,839 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:15:29,839 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,839 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:29,840 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:29,842 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:29,844 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:29,850 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:29,850 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:29,851 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:29,851 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:29,851 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. started... 2023-07-12 08:15:29,851 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. started... 2023-07-12 08:15:29,851 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6ee5c2dcd3ab83de5bec770032fe40ef 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-12 08:15:29,851 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b31d2191d052f69a70ef5bf948a0012d 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-12 08:15:29,872 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:29,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:29,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:29,873 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:29,896 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307128ac4fea20199478c9600169d11c9b632 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307128ac4fea20199478c9600169d11c9b632 2023-07-12 08:15:29,902 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712e123b8b83591407ea250411cce1217c3 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712e123b8b83591407ea250411cce1217c3 2023-07-12 08:15:29,915 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/.tmp/cf/10fe5c143c784359baba34945079d4ce 2023-07-12 08:15:29,922 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/.tmp/cf/10fe5c143c784359baba34945079d4ce as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf/10fe5c143c784359baba34945079d4ce 2023-07-12 08:15:29,926 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf/10fe5c143c784359baba34945079d4ce, entries=1, sequenceid=6, filesize=5.1 K 2023-07-12 08:15:29,927 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 6ee5c2dcd3ab83de5bec770032fe40ef in 76ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:29,927 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-12 08:15:29,928 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6ee5c2dcd3ab83de5bec770032fe40ef: 2023-07-12 08:15:29,928 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,928 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:29,928 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf/10fe5c143c784359baba34945079d4ce] hfiles 2023-07-12 08:15:29,928 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf/10fe5c143c784359baba34945079d4ce for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,944 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/.tmp/cf/16fcbc51d8964bbab09ec22662546b38 2023-07-12 08:15:29,953 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/.tmp/cf/16fcbc51d8964bbab09ec22662546b38 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf/16fcbc51d8964bbab09ec22662546b38 2023-07-12 08:15:29,959 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf/16fcbc51d8964bbab09ec22662546b38, entries=49, sequenceid=6, filesize=13.9 K 2023-07-12 08:15:29,961 INFO [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for b31d2191d052f69a70ef5bf948a0012d in 110ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:29,963 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b31d2191d052f69a70ef5bf948a0012d: 2023-07-12 08:15:29,963 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,963 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:29,963 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf/16fcbc51d8964bbab09ec22662546b38] hfiles 2023-07-12 08:15:29,963 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf/16fcbc51d8964bbab09ec22662546b38 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,973 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. completed. 2023-07-12 08:15:29,974 DEBUG [rs(jenkins-hbase4.apache.org,43379,1689149646981)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:29,974 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:29,974 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:29,974 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,974 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:29,974 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:15:29,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,976 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:29,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:29,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:29,976 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:29,977 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:29,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:29,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:29,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43379,1689149646981': 2023-07-12 08:15:29,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-12 08:15:30,074 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:30,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:30,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:30,075 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:30,355 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. completed. 2023-07-12 08:15:30,356 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:30,356 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:30,356 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:30,356 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,356 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-12 08:15:30,356 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:15:30,358 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,358 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-12 08:15:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:30,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:30,358 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:30,358 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-12 08:15:30,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:30,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:15:30,364 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-12 08:15:30,364 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-12 08:15:30,364 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:30,364 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:30,364 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,364 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:30,371 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,371 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,371 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:30,371 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,372 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:30,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:30,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:30,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:30,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:30,373 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,373 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:30,374 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,375 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:30,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:30,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:30,377 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:15:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:30,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,380 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,380 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,381 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:30,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:30,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:30,384 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,384 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,386 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:30,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:30,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:30,384 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:30,384 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:30,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:30,386 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,386 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:30,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,387 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:30,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712e123b8b83591407ea250411cce1217c3, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307128ac4fea20199478c9600169d11c9b632] mob files 2023-07-12 08:15:30,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:30,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:30,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712e123b8b83591407ea250411cce1217c3 2023-07-12 08:15:30,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307128ac4fea20199478c9600169d11c9b632 2023-07-12 08:15:30,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,395 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,450 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-12 08:15:30,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,450 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:30,450 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689149729770Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689149730395 (+625 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689149730395Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689149730395Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689149730399 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689149730416 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689149730450 (+34 ms) 2023-07-12 08:15:30,453 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-12 08:15:30,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 682 msec 2023-07-12 08:15:30,877 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-12 08:15:30,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:30,931 DEBUG [Listener at jenkins-hbase4.apache.org/35773] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:15:30,939 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:15:30,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 08:15:30,942 DEBUG [Listener at jenkins-hbase4.apache.org/35773] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:15:30,952 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:15:30,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 08:15:30,953 DEBUG [Listener at jenkins-hbase4.apache.org/35773] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-12 08:15:30,961 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-12 08:15:30,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43379] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-12 08:15:30,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-12 08:15:30,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:30,968 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:15:30,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-12 08:15:30,969 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:15:30,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:30,975 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:30,978 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 empty. 2023-07-12 08:15:30,978 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:30,979 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:30,979 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 empty. 2023-07-12 08:15:30,979 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:30,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 08:15:31,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:31,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:31,404 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-12 08:15:31,409 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e1a1651ac8c92c740c19c09554c0793, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:15:31,411 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 30b64ed22a8a53e1a9f791c689119c58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:15:31,440 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:31,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5e1a1651ac8c92c740c19c09554c0793, disabling compactions & flushes 2023-07-12 08:15:31,441 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. after waiting 0 ms 2023-07-12 08:15:31,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,441 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,441 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5e1a1651ac8c92c740c19c09554c0793: 2023-07-12 08:15:31,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:31,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 30b64ed22a8a53e1a9f791c689119c58, disabling compactions & flushes 2023-07-12 08:15:31,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,444 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,445 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. after waiting 0 ms 2023-07-12 08:15:31,445 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,445 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,445 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 30b64ed22a8a53e1a9f791c689119c58: 2023-07-12 08:15:31,451 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:15:31,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149731452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149731452"}]},"ts":"1689149731452"} 2023-07-12 08:15:31,452 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149731452"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149731452"}]},"ts":"1689149731452"} 2023-07-12 08:15:31,462 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:15:31,463 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:15:31,463 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149731463"}]},"ts":"1689149731463"} 2023-07-12 08:15:31,464 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-12 08:15:31,468 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:15:31,469 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:15:31,469 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:15:31,469 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:15:31,469 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:15:31,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, ASSIGN}] 2023-07-12 08:15:31,475 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, ASSIGN 2023-07-12 08:15:31,476 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, ASSIGN 2023-07-12 08:15:31,476 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:15:31,477 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39637,1689149647017; forceNewPlan=false, retain=false 2023-07-12 08:15:31,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:31,627 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:15:31,630 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=30b64ed22a8a53e1a9f791c689119c58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:31,630 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5e1a1651ac8c92c740c19c09554c0793, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:31,630 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149731630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149731630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149731630"}]},"ts":"1689149731630"} 2023-07-12 08:15:31,630 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149731630"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149731630"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149731630"}]},"ts":"1689149731630"} 2023-07-12 08:15:31,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 30b64ed22a8a53e1a9f791c689119c58, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:15:31,634 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 5e1a1651ac8c92c740c19c09554c0793, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:15:31,739 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0004_000001 (auth:SIMPLE) 2023-07-12 08:15:31,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 30b64ed22a8a53e1a9f791c689119c58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.', STARTKEY => '2', ENDKEY => ''} 2023-07-12 08:15:31,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. service=AccessControlService 2023-07-12 08:15:31,801 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:31,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:31,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,806 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e1a1651ac8c92c740c19c09554c0793, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.', STARTKEY => '', ENDKEY => '2'} 2023-07-12 08:15:31,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. service=AccessControlService 2023-07-12 08:15:31,807 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:31,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:31,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,807 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,808 INFO [StoreOpener-30b64ed22a8a53e1a9f791c689119c58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,811 INFO [StoreOpener-5e1a1651ac8c92c740c19c09554c0793-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,813 DEBUG [StoreOpener-30b64ed22a8a53e1a9f791c689119c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf 2023-07-12 08:15:31,813 DEBUG [StoreOpener-30b64ed22a8a53e1a9f791c689119c58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf 2023-07-12 08:15:31,813 DEBUG [StoreOpener-5e1a1651ac8c92c740c19c09554c0793-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf 2023-07-12 08:15:31,814 DEBUG [StoreOpener-5e1a1651ac8c92c740c19c09554c0793-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf 2023-07-12 08:15:31,814 INFO [StoreOpener-30b64ed22a8a53e1a9f791c689119c58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 30b64ed22a8a53e1a9f791c689119c58 columnFamilyName cf 2023-07-12 08:15:31,814 INFO [StoreOpener-5e1a1651ac8c92c740c19c09554c0793-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e1a1651ac8c92c740c19c09554c0793 columnFamilyName cf 2023-07-12 08:15:31,815 INFO [StoreOpener-5e1a1651ac8c92c740c19c09554c0793-1] regionserver.HStore(310): Store=5e1a1651ac8c92c740c19c09554c0793/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:31,815 INFO [StoreOpener-30b64ed22a8a53e1a9f791c689119c58-1] regionserver.HStore(310): Store=30b64ed22a8a53e1a9f791c689119c58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:31,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:31,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:31,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:31,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:31,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 30b64ed22a8a53e1a9f791c689119c58; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74486550, jitterRate=0.10993608832359314}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:31,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 30b64ed22a8a53e1a9f791c689119c58: 2023-07-12 08:15:31,829 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5e1a1651ac8c92c740c19c09554c0793; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73518966, jitterRate=0.09551796317100525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:31,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5e1a1651ac8c92c740c19c09554c0793: 2023-07-12 08:15:31,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58., pid=69, masterSystemTime=1689149731791 2023-07-12 08:15:31,830 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793., pid=70, masterSystemTime=1689149731791 2023-07-12 08:15:31,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:31,833 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5e1a1651ac8c92c740c19c09554c0793, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:31,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:31,834 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149731833"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149731833"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149731833"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149731833"}]},"ts":"1689149731833"} 2023-07-12 08:15:31,834 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=30b64ed22a8a53e1a9f791c689119c58, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:31,834 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149731834"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149731834"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149731834"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149731834"}]},"ts":"1689149731834"} 2023-07-12 08:15:31,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-12 08:15:31,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 5e1a1651ac8c92c740c19c09554c0793, server=jenkins-hbase4.apache.org,39637,1689149647017 in 202 msec 2023-07-12 08:15:31,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, ASSIGN in 370 msec 2023-07-12 08:15:31,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-12 08:15:31,842 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 30b64ed22a8a53e1a9f791c689119c58, server=jenkins-hbase4.apache.org,40943,1689149646919 in 206 msec 2023-07-12 08:15:31,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-12 08:15:31,845 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, ASSIGN in 373 msec 2023-07-12 08:15:31,846 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:15:31,847 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149731846"}]},"ts":"1689149731846"} 2023-07-12 08:15:31,848 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-12 08:15:31,851 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:15:31,851 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-12 08:15:31,853 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 08:15:31,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:31,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:31,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:31,856 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:31,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,858 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,859 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:31,860 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 894 msec 2023-07-12 08:15:32,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-12 08:15:32,076 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-12 08:15:32,110 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5e1a1651ac8c92c740c19c09554c0793, 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:32,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5e1a1651ac8c92c740c19c09554c0793, 30b64ed22a8a53e1a9f791c689119c58], force=true 2023-07-12 08:15:32,124 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5e1a1651ac8c92c740c19c09554c0793, 30b64ed22a8a53e1a9f791c689119c58], force=true 2023-07-12 08:15:32,124 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5e1a1651ac8c92c740c19c09554c0793, 30b64ed22a8a53e1a9f791c689119c58], force=true 2023-07-12 08:15:32,124 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5e1a1651ac8c92c740c19c09554c0793, 30b64ed22a8a53e1a9f791c689119c58], force=true 2023-07-12 08:15:32,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:32,156 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, UNASSIGN}] 2023-07-12 08:15:32,160 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, UNASSIGN 2023-07-12 08:15:32,160 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, UNASSIGN 2023-07-12 08:15:32,161 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=30b64ed22a8a53e1a9f791c689119c58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:32,161 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5e1a1651ac8c92c740c19c09554c0793, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:32,161 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149732161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149732161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149732161"}]},"ts":"1689149732161"} 2023-07-12 08:15:32,161 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149732161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149732161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149732161"}]},"ts":"1689149732161"} 2023-07-12 08:15:32,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 5e1a1651ac8c92c740c19c09554c0793, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:15:32,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 30b64ed22a8a53e1a9f791c689119c58, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:15:32,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:32,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5e1a1651ac8c92c740c19c09554c0793, disabling compactions & flushes 2023-07-12 08:15:32,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. after waiting 0 ms 2023-07-12 08:15:32,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:32,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5e1a1651ac8c92c740c19c09554c0793 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 08:15:32,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 30b64ed22a8a53e1a9f791c689119c58, disabling compactions & flushes 2023-07-12 08:15:32,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. after waiting 0 ms 2023-07-12 08:15:32,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:32,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 30b64ed22a8a53e1a9f791c689119c58 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-12 08:15:32,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/.tmp/cf/d751b25fabf844b58a5da65102fab846 2023-07-12 08:15:32,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/.tmp/cf/d751b25fabf844b58a5da65102fab846 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf/d751b25fabf844b58a5da65102fab846 2023-07-12 08:15:32,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf/d751b25fabf844b58a5da65102fab846, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 08:15:32,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 30b64ed22a8a53e1a9f791c689119c58 in 45ms, sequenceid=5, compaction requested=false 2023-07-12 08:15:32,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 08:15:32,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 08:15:32,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:32,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58. 2023-07-12 08:15:32,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 30b64ed22a8a53e1a9f791c689119c58: 2023-07-12 08:15:32,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:32,381 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=30b64ed22a8a53e1a9f791c689119c58, regionState=CLOSED 2023-07-12 08:15:32,381 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149732381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149732381"}]},"ts":"1689149732381"} 2023-07-12 08:15:32,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-12 08:15:32,384 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 30b64ed22a8a53e1a9f791c689119c58, server=jenkins-hbase4.apache.org,40943,1689149646919 in 216 msec 2023-07-12 08:15:32,385 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=30b64ed22a8a53e1a9f791c689119c58, UNASSIGN in 228 msec 2023-07-12 08:15:32,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:32,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:32,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/.tmp/cf/44ecb68b48504bfaacbf00016729f7e0 2023-07-12 08:15:32,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/.tmp/cf/44ecb68b48504bfaacbf00016729f7e0 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf/44ecb68b48504bfaacbf00016729f7e0 2023-07-12 08:15:32,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf/44ecb68b48504bfaacbf00016729f7e0, entries=1, sequenceid=5, filesize=4.7 K 2023-07-12 08:15:32,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5e1a1651ac8c92c740c19c09554c0793 in 437ms, sequenceid=5, compaction requested=false 2023-07-12 08:15:32,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-12 08:15:32,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:32,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793. 2023-07-12 08:15:32,801 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5e1a1651ac8c92c740c19c09554c0793: 2023-07-12 08:15:32,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:32,804 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5e1a1651ac8c92c740c19c09554c0793, regionState=CLOSED 2023-07-12 08:15:32,804 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689149732804"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149732804"}]},"ts":"1689149732804"} 2023-07-12 08:15:32,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-12 08:15:32,810 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 5e1a1651ac8c92c740c19c09554c0793, server=jenkins-hbase4.apache.org,39637,1689149647017 in 640 msec 2023-07-12 08:15:32,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-12 08:15:32,817 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5e1a1651ac8c92c740c19c09554c0793, UNASSIGN in 659 msec 2023-07-12 08:15:32,952 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-12 08:15:32,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730964.5e1a1651ac8c92c740c19c09554c0793.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:32,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689149730964.30b64ed22a8a53e1a9f791c689119c58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:32,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:33,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, ASSIGN}] 2023-07-12 08:15:33,027 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, ASSIGN 2023-07-12 08:15:33,028 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39637,1689149647017; forceNewPlan=false, retain=false 2023-07-12 08:15:33,100 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:33,178 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-12 08:15:33,188 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dd958834cbfedc78aa2277f208cccbf4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:33,188 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149733188"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149733188"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149733188"}]},"ts":"1689149733188"} 2023-07-12 08:15:33,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure dd958834cbfedc78aa2277f208cccbf4, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:15:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:33,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:33,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd958834cbfedc78aa2277f208cccbf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.', STARTKEY => '', ENDKEY => ''} 2023-07-12 08:15:33,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. service=AccessControlService 2023-07-12 08:15:33,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:33,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:33,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/.regioninfo 2023-07-12 08:15:33,389 INFO [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,391 DEBUG [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf 2023-07-12 08:15:33,391 DEBUG [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf 2023-07-12 08:15:33,391 INFO [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd958834cbfedc78aa2277f208cccbf4 columnFamilyName cf 2023-07-12 08:15:33,442 DEBUG [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] regionserver.HStore(539): loaded hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/44ecb68b48504bfaacbf00016729f7e0.5e1a1651ac8c92c740c19c09554c0793->hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf/44ecb68b48504bfaacbf00016729f7e0-top 2023-07-12 08:15:33,457 DEBUG [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] regionserver.HStore(539): loaded hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/d751b25fabf844b58a5da65102fab846.30b64ed22a8a53e1a9f791c689119c58->hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf/d751b25fabf844b58a5da65102fab846-top 2023-07-12 08:15:33,458 INFO [StoreOpener-dd958834cbfedc78aa2277f208cccbf4-1] regionserver.HStore(310): Store=dd958834cbfedc78aa2277f208cccbf4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:33,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,461 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,465 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:33,470 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd958834cbfedc78aa2277f208cccbf4; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70294812, jitterRate=0.04747432470321655}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:33,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd958834cbfedc78aa2277f208cccbf4: 2023-07-12 08:15:33,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4., pid=77, masterSystemTime=1689149733342 2023-07-12 08:15:33,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.,because compaction is disabled. 2023-07-12 08:15:33,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:33,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:33,474 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=dd958834cbfedc78aa2277f208cccbf4, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:33,475 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149733474"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149733474"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149733474"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149733474"}]},"ts":"1689149733474"} 2023-07-12 08:15:33,483 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-12 08:15:33,484 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure dd958834cbfedc78aa2277f208cccbf4, server=jenkins-hbase4.apache.org,39637,1689149647017 in 289 msec 2023-07-12 08:15:33,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-12 08:15:33,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, ASSIGN in 470 msec 2023-07-12 08:15:33,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5e1a1651ac8c92c740c19c09554c0793, 30b64ed22a8a53e1a9f791c689119c58], force=true in 1.3720 sec 2023-07-12 08:15:34,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-12 08:15:34,238 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-12 08:15:34,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 08:15:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149734239 (current time:1689149734239). 2023-07-12 08:15:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:34,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x70bb8049 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:34,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a741d89, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:34,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:34,276 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70bb8049 to 127.0.0.1:55996 2023-07-12 08:15:34,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:34,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x6fc02765 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:34,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@43555b1c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:34,331 DEBUG [hconnection-0x59579eaa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:34,341 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:34,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:34,359 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:34,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6fc02765 to 127.0.0.1:55996 2023-07-12 08:15:34,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:34,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-12 08:15:34,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:34,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 08:15:34,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 08:15:34,373 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 08:15:34,374 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689150334374 2023-07-12 08:15:34,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-12 08:15:34,374 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,380 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:34,380 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:34,391 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 08:15:34,393 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-12 08:15:34,396 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 25 msec 2023-07-12 08:15:34,398 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 08:15:34,399 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689150334399 2023-07-12 08:15:34,448 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,448 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-12 08:15:34,448 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:34,449 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-12 08:15:34,449 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-12 08:15:34,450 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,450 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,452 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:34,452 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:34,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:34,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:34,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:34,453 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,456 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:34,456 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:34,457 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,457 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:34,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 08:15:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,458 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 08:15:34,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,458 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 08:15:34,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,459 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 08:15:34,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,467 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,467 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 08:15:34,467 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:34,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,467 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 08:15:34,472 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 08:15:34,472 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 08:15:34,472 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 08:15:34,472 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:34,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-12 08:15:34,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,474 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-12 08:15:34,474 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 08:15:34,474 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 08:15:34,474 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 08:15:34,476 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,477 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,477 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:34,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:34,477 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:34,477 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:34,478 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,478 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,479 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-12 08:15:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,479 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:34,480 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:34,480 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-12 08:15:34,481 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-12 08:15:34,481 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-12 08:15:34,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:34,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 08:15:34,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:34,484 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:34,485 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-12 08:15:34,485 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@378c5131[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:34,485 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-12 08:15:34,485 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,485 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,485 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:34,487 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 08:15:34,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 08:15:34,487 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 08:15:34,487 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,487 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:34,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,487 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:15:34,488 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-12 08:15:34,488 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 08:15:34,488 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:15:34,489 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 08:15:34,489 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:34,489 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 08:15:34,490 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 08:15:34,490 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:34,490 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 08:15:34,491 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:34,505 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:34,505 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:34,505 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. started... 2023-07-12 08:15:34,507 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dd958834cbfedc78aa2277f208cccbf4: 2023-07-12 08:15:34,507 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,507 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:34,508 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/44ecb68b48504bfaacbf00016729f7e0.5e1a1651ac8c92c740c19c09554c0793->hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf/44ecb68b48504bfaacbf00016729f7e0-top, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/d751b25fabf844b58a5da65102fab846.30b64ed22a8a53e1a9f791c689119c58->hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf/d751b25fabf844b58a5da65102fab846-top] hfiles 2023-07-12 08:15:34,508 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/44ecb68b48504bfaacbf00016729f7e0.5e1a1651ac8c92c740c19c09554c0793 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,509 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/d751b25fabf844b58a5da65102fab846.30b64ed22a8a53e1a9f791c689119c58 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,529 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. completed. 2023-07-12 08:15:34,529 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:34,529 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-12 08:15:34,530 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:15:34,538 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-12 08:15:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:34,538 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-12 08:15:34,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:34,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:34,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:15:34,552 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-12 08:15:34,552 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-12 08:15:34,552 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:34,552 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:34,552 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,552 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:34,556 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,556 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:34,557 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:34,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:34,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:34,557 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,557 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:34,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:34,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:34,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:34,559 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,563 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:34,563 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,567 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:34,568 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,571 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:34,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:34,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:34,577 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:34,577 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:34,576 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:34,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:34,577 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:34,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,578 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:34,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:34,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:34,578 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:34,684 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:34,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 08:15:34,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:34,686 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:34,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,772 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-12 08:15:34,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,772 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:34,772 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689149734374Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149734577 (+203 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149734577Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149734581 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689149734641 (+60 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689149734772 (+131 ms) 2023-07-12 08:15:34,776 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-12 08:15:34,778 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 396 msec 2023-07-12 08:15:34,986 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:34,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-12 08:15:34,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:34,988 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988 2023-07-12 08:15:34,988 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41579, tgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988, rawTgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:15:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:15:35,029 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1177010164_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:35,029 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-12 08:15:35,082 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:35,231 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:35,231 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:35,232 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:35,233 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,466 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-7678653348632095801.jar 2023-07-12 08:15:36,466 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,467 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,557 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-5062825712225387828.jar 2023-07-12 08:15:36,558 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,558 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,559 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,560 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,560 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,561 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:36,561 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:15:36,562 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:15:36,563 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:15:36,563 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:15:36,564 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:15:36,564 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:15:36,565 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:15:36,565 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:15:36,566 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:15:36,567 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:15:36,567 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:36,568 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:36,569 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:36,569 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:36,570 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:36,571 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:36,571 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:38,250 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:15:38,254 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-12 08:15:38,256 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-12 08:15:38,301 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:38,339 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:38,339 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:38,425 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:44,258 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:46,598 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:51,589 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:15:51,592 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:15:51,609 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,609 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:15:51,610 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:15:51,610 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,611 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 08:15:51,611 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 08:15:51,611 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,612 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-12 08:15:51,612 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149734988/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-12 08:15:51,619 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 08:15:51,624 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149751624"}]},"ts":"1689149751624"} 2023-07-12 08:15:51,626 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-12 08:15:51,628 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-12 08:15:51,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, UNASSIGN}] 2023-07-12 08:15:51,632 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, UNASSIGN 2023-07-12 08:15:51,633 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dd958834cbfedc78aa2277f208cccbf4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:51,633 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149751633"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149751633"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149751633"}]},"ts":"1689149751633"} 2023-07-12 08:15:51,634 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure dd958834cbfedc78aa2277f208cccbf4, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:15:51,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 08:15:51,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:51,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd958834cbfedc78aa2277f208cccbf4, disabling compactions & flushes 2023-07-12 08:15:51,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:51,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:51,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. after waiting 0 ms 2023-07-12 08:15:51,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:51,813 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-12 08:15:51,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:51,815 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4. 2023-07-12 08:15:51,815 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd958834cbfedc78aa2277f208cccbf4: 2023-07-12 08:15:51,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:51,817 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=dd958834cbfedc78aa2277f208cccbf4, regionState=CLOSED 2023-07-12 08:15:51,817 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689149751817"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149751817"}]},"ts":"1689149751817"} 2023-07-12 08:15:51,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-12 08:15:51,820 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure dd958834cbfedc78aa2277f208cccbf4, server=jenkins-hbase4.apache.org,39637,1689149647017 in 185 msec 2023-07-12 08:15:51,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-12 08:15:51,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=dd958834cbfedc78aa2277f208cccbf4, UNASSIGN in 191 msec 2023-07-12 08:15:51,822 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149751822"}]},"ts":"1689149751822"} 2023-07-12 08:15:51,824 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-12 08:15:51,825 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-12 08:15:51,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 207 msec 2023-07-12 08:15:51,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-12 08:15:51,928 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-12 08:15:51,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,935 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,937 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,939 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:51,939 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:51,940 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:51,941 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,941 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,941 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:51,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:51,942 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-12 08:15:51,942 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/recovered.edits] 2023-07-12 08:15:51,943 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/recovered.edits] 2023-07-12 08:15:51,943 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,944 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:51,944 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,944 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:51,945 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,945 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:51,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:51,945 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,945 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:51,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 08:15:51,945 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-12 08:15:51,945 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-12 08:15:51,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:51,946 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:51,947 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:51,947 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/recovered.edits] 2023-07-12 08:15:51,952 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf/d751b25fabf844b58a5da65102fab846 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/cf/d751b25fabf844b58a5da65102fab846 2023-07-12 08:15:51,954 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/44ecb68b48504bfaacbf00016729f7e0.5e1a1651ac8c92c740c19c09554c0793 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/44ecb68b48504bfaacbf00016729f7e0.5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:51,956 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/d751b25fabf844b58a5da65102fab846.30b64ed22a8a53e1a9f791c689119c58 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/cf/d751b25fabf844b58a5da65102fab846.30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:51,956 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/recovered.edits/8.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58/recovered.edits/8.seqid 2023-07-12 08:15:51,957 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/30b64ed22a8a53e1a9f791c689119c58 2023-07-12 08:15:51,962 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/recovered.edits/12.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4/recovered.edits/12.seqid 2023-07-12 08:15:51,962 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf/44ecb68b48504bfaacbf00016729f7e0 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/cf/44ecb68b48504bfaacbf00016729f7e0 2023-07-12 08:15:51,962 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/dd958834cbfedc78aa2277f208cccbf4 2023-07-12 08:15:51,968 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/recovered.edits/8.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793/recovered.edits/8.seqid 2023-07-12 08:15:51,968 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5e1a1651ac8c92c740c19c09554c0793 2023-07-12 08:15:51,968 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-12 08:15:51,972 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,981 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-12 08:15:51,983 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-12 08:15:51,985 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,985 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-12 08:15:51,985 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149751985"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:51,988 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-12 08:15:51,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dd958834cbfedc78aa2277f208cccbf4, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689149730965.dd958834cbfedc78aa2277f208cccbf4.', STARTKEY => '', ENDKEY => ''}] 2023-07-12 08:15:51,988 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-12 08:15:51,988 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149751988"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:51,990 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-12 08:15:51,995 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:51,996 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 66 msec 2023-07-12 08:15:52,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-12 08:15:52,047 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-12 08:15:52,047 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 08:15:52,054 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149752053"}]},"ts":"1689149752053"} 2023-07-12 08:15:52,055 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-12 08:15:52,057 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-12 08:15:52,058 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, UNASSIGN}] 2023-07-12 08:15:52,059 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, UNASSIGN 2023-07-12 08:15:52,060 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, UNASSIGN 2023-07-12 08:15:52,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=6ee5c2dcd3ab83de5bec770032fe40ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:52,063 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149752062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149752062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149752062"}]},"ts":"1689149752062"} 2023-07-12 08:15:52,063 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b31d2191d052f69a70ef5bf948a0012d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:52,063 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149752063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149752063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149752063"}]},"ts":"1689149752063"} 2023-07-12 08:15:52,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 6ee5c2dcd3ab83de5bec770032fe40ef, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:15:52,068 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure b31d2191d052f69a70ef5bf948a0012d, server=jenkins-hbase4.apache.org,43379,1689149646981}] 2023-07-12 08:15:52,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 08:15:52,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:52,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6ee5c2dcd3ab83de5bec770032fe40ef, disabling compactions & flushes 2023-07-12 08:15:52,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:52,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:52,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. after waiting 0 ms 2023-07-12 08:15:52,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:52,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:52,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b31d2191d052f69a70ef5bf948a0012d, disabling compactions & flushes 2023-07-12 08:15:52,221 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:52,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:52,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. after waiting 0 ms 2023-07-12 08:15:52,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:52,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:52,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:15:52,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:52,244 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:15:52,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef. 2023-07-12 08:15:52,246 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d. 2023-07-12 08:15:52,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6ee5c2dcd3ab83de5bec770032fe40ef: 2023-07-12 08:15:52,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b31d2191d052f69a70ef5bf948a0012d: 2023-07-12 08:15:52,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:52,248 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=6ee5c2dcd3ab83de5bec770032fe40ef, regionState=CLOSED 2023-07-12 08:15:52,248 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:52,248 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149752248"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149752248"}]},"ts":"1689149752248"} 2023-07-12 08:15:52,249 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b31d2191d052f69a70ef5bf948a0012d, regionState=CLOSED 2023-07-12 08:15:52,249 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689149752249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149752249"}]},"ts":"1689149752249"} 2023-07-12 08:15:52,258 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-12 08:15:52,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 6ee5c2dcd3ab83de5bec770032fe40ef, server=jenkins-hbase4.apache.org,40943,1689149646919 in 189 msec 2023-07-12 08:15:52,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-12 08:15:52,260 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure b31d2191d052f69a70ef5bf948a0012d, server=jenkins-hbase4.apache.org,43379,1689149646981 in 189 msec 2023-07-12 08:15:52,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6ee5c2dcd3ab83de5bec770032fe40ef, UNASSIGN in 200 msec 2023-07-12 08:15:52,261 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-12 08:15:52,262 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b31d2191d052f69a70ef5bf948a0012d, UNASSIGN in 202 msec 2023-07-12 08:15:52,262 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149752262"}]},"ts":"1689149752262"} 2023-07-12 08:15:52,264 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-12 08:15:52,266 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-12 08:15:52,268 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 219 msec 2023-07-12 08:15:52,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-12 08:15:52,356 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-12 08:15:52,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,361 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,361 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,364 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:52,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:52,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:52,368 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:52,368 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:52,368 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-12 08:15:52,369 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,369 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:52,369 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,369 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:52,370 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,370 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:52,371 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/recovered.edits] 2023-07-12 08:15:52,372 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/recovered.edits] 2023-07-12 08:15:52,372 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,373 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:52,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 08:15:52,378 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf/16fcbc51d8964bbab09ec22662546b38 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/cf/16fcbc51d8964bbab09ec22662546b38 2023-07-12 08:15:52,385 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf/10fe5c143c784359baba34945079d4ce to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/cf/10fe5c143c784359baba34945079d4ce 2023-07-12 08:15:52,388 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d/recovered.edits/9.seqid 2023-07-12 08:15:52,389 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b31d2191d052f69a70ef5bf948a0012d 2023-07-12 08:15:52,390 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef/recovered.edits/9.seqid 2023-07-12 08:15:52,390 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6ee5c2dcd3ab83de5bec770032fe40ef 2023-07-12 08:15:52,391 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-12 08:15:52,391 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 08:15:52,392 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-12 08:15:52,396 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712e123b8b83591407ea250411cce1217c3 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230712e123b8b83591407ea250411cce1217c3 2023-07-12 08:15:52,398 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307128ac4fea20199478c9600169d11c9b632 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307128ac4fea20199478c9600169d11c9b632 2023-07-12 08:15:52,399 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-12 08:15:52,402 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,404 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-12 08:15:52,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-12 08:15:52,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-12 08:15:52,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149752409"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:52,409 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149752409"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:52,411 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:15:52,411 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6ee5c2dcd3ab83de5bec770032fe40ef, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689149727819.6ee5c2dcd3ab83de5bec770032fe40ef.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b31d2191d052f69a70ef5bf948a0012d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689149727819.b31d2191d052f69a70ef5bf948a0012d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:15:52,411 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-12 08:15:52,411 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149752411"}]},"ts":"9223372036854775807"} 2023-07-12 08:15:52,412 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-12 08:15:52,415 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,416 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 58 msec 2023-07-12 08:15:52,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-12 08:15:52,475 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-12 08:15:52,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 08:15:52,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-12 08:15:52,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-12 08:15:52,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-12 08:15:52,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-12 08:15:52,540 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:47866 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1129764444_1 at /127.0.0.1:45734 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4228 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:45758 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:47622 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:47630 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1129764444_1 at /127.0.0.1:47852 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:36303 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=907 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=598 (was 455) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 180), AvailableMemoryMB=3014 (was 3105) 2023-07-12 08:15:52,540 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 08:15:52,567 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=907, MaxFileDescriptor=60000, SystemLoadAverage=598, ProcessCount=177, AvailableMemoryMB=3011 2023-07-12 08:15:52,567 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-12 08:15:52,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 08:15:52,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:15:52,573 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:15:52,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-12 08:15:52,574 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:15:52,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:52,577 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:52,577 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:52,578 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb empty. 2023-07-12 08:15:52,578 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef empty. 2023-07-12 08:15:52,578 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:52,578 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:52,578 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 08:15:52,608 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-12 08:15:52,610 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 530eb0c473ed47cbe3aacc94c6f874bb, NAME => 'testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:15:52,610 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b13613492f5410c481bf7922f607eeef, NAME => 'testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:15:52,651 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:52,652 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 530eb0c473ed47cbe3aacc94c6f874bb, disabling compactions & flushes 2023-07-12 08:15:52,652 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:52,652 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:52,652 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. after waiting 0 ms 2023-07-12 08:15:52,652 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:52,652 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:52,652 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 530eb0c473ed47cbe3aacc94c6f874bb: 2023-07-12 08:15:52,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:52,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b13613492f5410c481bf7922f607eeef, disabling compactions & flushes 2023-07-12 08:15:52,663 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:52,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:52,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. after waiting 0 ms 2023-07-12 08:15:52,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:52,663 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:52,663 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b13613492f5410c481bf7922f607eeef: 2023-07-12 08:15:52,666 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:15:52,667 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149752667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149752667"}]},"ts":"1689149752667"} 2023-07-12 08:15:52,667 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149752667"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149752667"}]},"ts":"1689149752667"} 2023-07-12 08:15:52,670 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:15:52,672 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:15:52,672 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149752672"}]},"ts":"1689149752672"} 2023-07-12 08:15:52,673 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-12 08:15:52,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:52,677 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:15:52,679 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:15:52,679 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:15:52,679 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:15:52,679 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:15:52,679 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, ASSIGN}] 2023-07-12 08:15:52,682 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, ASSIGN 2023-07-12 08:15:52,682 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, ASSIGN 2023-07-12 08:15:52,685 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:15:52,685 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39637,1689149647017; forceNewPlan=false, retain=false 2023-07-12 08:15:52,835 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:15:52,839 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=530eb0c473ed47cbe3aacc94c6f874bb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:52,839 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b13613492f5410c481bf7922f607eeef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:52,839 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149752839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149752839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149752839"}]},"ts":"1689149752839"} 2023-07-12 08:15:52,839 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149752839"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149752839"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149752839"}]},"ts":"1689149752839"} 2023-07-12 08:15:52,842 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 530eb0c473ed47cbe3aacc94c6f874bb, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:15:52,843 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure b13613492f5410c481bf7922f607eeef, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:15:52,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:53,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:53,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:53,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 530eb0c473ed47cbe3aacc94c6f874bb, NAME => 'testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:15:53,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b13613492f5410c481bf7922f607eeef, NAME => 'testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. service=AccessControlService 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. service=AccessControlService 2023-07-12 08:15:53,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:53,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,004 INFO [StoreOpener-530eb0c473ed47cbe3aacc94c6f874bb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,004 INFO [StoreOpener-b13613492f5410c481bf7922f607eeef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,006 DEBUG [StoreOpener-b13613492f5410c481bf7922f607eeef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf 2023-07-12 08:15:53,006 DEBUG [StoreOpener-b13613492f5410c481bf7922f607eeef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf 2023-07-12 08:15:53,006 INFO [StoreOpener-b13613492f5410c481bf7922f607eeef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b13613492f5410c481bf7922f607eeef columnFamilyName cf 2023-07-12 08:15:53,007 DEBUG [StoreOpener-530eb0c473ed47cbe3aacc94c6f874bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf 2023-07-12 08:15:53,007 DEBUG [StoreOpener-530eb0c473ed47cbe3aacc94c6f874bb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf 2023-07-12 08:15:53,008 INFO [StoreOpener-530eb0c473ed47cbe3aacc94c6f874bb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 530eb0c473ed47cbe3aacc94c6f874bb columnFamilyName cf 2023-07-12 08:15:53,008 INFO [StoreOpener-b13613492f5410c481bf7922f607eeef-1] regionserver.HStore(310): Store=b13613492f5410c481bf7922f607eeef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:53,009 INFO [StoreOpener-530eb0c473ed47cbe3aacc94c6f874bb-1] regionserver.HStore(310): Store=530eb0c473ed47cbe3aacc94c6f874bb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:15:53,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b13613492f5410c481bf7922f607eeef 2023-07-12 08:15:53,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:53,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b13613492f5410c481bf7922f607eeef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72318226, jitterRate=0.07762554287910461}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:53,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b13613492f5410c481bf7922f607eeef: 2023-07-12 08:15:53,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef., pid=94, masterSystemTime=1689149752998 2023-07-12 08:15:53,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:15:53,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:53,019 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:53,019 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b13613492f5410c481bf7922f607eeef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,020 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149753019"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149753019"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149753019"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149753019"}]},"ts":"1689149753019"} 2023-07-12 08:15:53,027 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:15:53,028 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 530eb0c473ed47cbe3aacc94c6f874bb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59165996, jitterRate=-0.11835795640945435}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:15:53,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 530eb0c473ed47cbe3aacc94c6f874bb: 2023-07-12 08:15:53,031 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb., pid=93, masterSystemTime=1689149752997 2023-07-12 08:15:53,034 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-12 08:15:53,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure b13613492f5410c481bf7922f607eeef, server=jenkins-hbase4.apache.org,40943,1689149646919 in 178 msec 2023-07-12 08:15:53,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:53,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:53,037 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=530eb0c473ed47cbe3aacc94c6f874bb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,037 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149753037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149753037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149753037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149753037"}]},"ts":"1689149753037"} 2023-07-12 08:15:53,038 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, ASSIGN in 356 msec 2023-07-12 08:15:53,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-12 08:15:53,041 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 530eb0c473ed47cbe3aacc94c6f874bb, server=jenkins-hbase4.apache.org,39637,1689149647017 in 197 msec 2023-07-12 08:15:53,042 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-12 08:15:53,043 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, ASSIGN in 362 msec 2023-07-12 08:15:53,043 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:15:53,043 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149753043"}]},"ts":"1689149753043"} 2023-07-12 08:15:53,045 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-12 08:15:53,048 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:15:53,048 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-12 08:15:53,050 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:15:53,053 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:53,053 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:53,053 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:53,053 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:15:53,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:53,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:53,055 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:53,056 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-12 08:15:53,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 487 msec 2023-07-12 08:15:53,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-12 08:15:53,181 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-12 08:15:53,186 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:53,186 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:53,188 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:53,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:53,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149753209 (current time:1689149753209). 2023-07-12 08:15:53,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:53,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x233dd03e to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:53,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fda1842, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:53,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:53,226 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:53,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x233dd03e to 127.0.0.1:55996 2023-07-12 08:15:53,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:53,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x58af0ba5 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:53,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15de9cae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:53,252 DEBUG [hconnection-0x2af99e5f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:53,261 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:53,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:53,269 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:53,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58af0ba5 to 127.0.0.1:55996 2023-07-12 08:15:53,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:15:53,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:53,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:53,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:53,285 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:53,285 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150353285 2023-07-12 08:15:53,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:53,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:53,288 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:53,288 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:53,292 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:53,293 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:53,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 18 msec 2023-07-12 08:15:53,299 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:53,300 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150353300 2023-07-12 08:15:53,314 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,315 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-12 08:15:53,315 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:53,316 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 08:15:53,317 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:15:53,317 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,317 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,327 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:53,327 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:53,327 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:53,327 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:53,327 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,327 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,328 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,328 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:53,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:53,329 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-12 08:15:53,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,330 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:53,335 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,335 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:53,336 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:53,342 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:53,342 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:53,342 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:53,344 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:53,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:53,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:53,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:53,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,347 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,347 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:53,347 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:53,347 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:53,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:53,352 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:53,351 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:53,356 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:53,356 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:53,354 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:53,356 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:53,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,357 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:53,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:53,360 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,360 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:53,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca4b5ed[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:53,361 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:53,361 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,361 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,363 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,364 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:53,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:53,365 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ca4b5ed[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:53,365 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:15:53,365 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,367 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:53,368 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:15:53,368 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:53,368 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,368 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:53,369 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:53,369 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:53,369 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. started... 2023-07-12 08:15:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:53,370 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:53,373 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:53,373 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:53,384 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:53,384 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b13613492f5410c481bf7922f607eeef: 2023-07-12 08:15:53,384 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. started... 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 530eb0c473ed47cbe3aacc94c6f874bb: 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:53,385 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:15:53,388 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:53,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:53,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:53,389 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:53,491 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. completed. 2023-07-12 08:15:53,491 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:53,491 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:53,491 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:53,491 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,491 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:53,491 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:15:53,493 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:53,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:53,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:53,494 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:53,502 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. completed. 2023-07-12 08:15:53,502 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:53,502 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:15:53,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:53,510 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:53,511 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:15:53,515 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:15:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:53,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:53,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:15:53,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:15:53,519 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 08:15:53,519 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:53,519 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:53,519 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,519 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:53,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,523 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:53,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:53,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:53,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:53,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:53,524 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:53,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:53,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:53,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,525 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,525 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:53,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:53,527 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,528 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,528 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,531 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:53,531 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:53,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:53,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:53,531 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,531 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:53,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:53,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:53,531 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:53,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,532 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:53,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,534 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:53,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:15:53,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:53,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:53,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 08:15:53,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:53,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:53,532 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:53,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:53,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:53,589 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:53,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:53,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:53,591 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:53,609 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,611 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:53,892 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:53,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:53,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:53,893 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:15:54,292 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 08:15:54,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,293 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689149753286Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689149753609 (+323 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689149753609Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689149753609Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689149753641 (+32 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689149753723 (+82 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689149754292 (+569 ms) 2023-07-12 08:15:54,297 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:54,299 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.0100 sec 2023-07-12 08:15:54,394 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:54,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:54,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:54,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:54,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:15:54,403 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:54,403 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:54,403 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:15:54,416 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:54,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149754416 (current time:1689149754416). 2023-07-12 08:15:54,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:15:54,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x117dd291 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:54,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7710ad87, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:54,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:54,458 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:54,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x117dd291 to 127.0.0.1:55996 2023-07-12 08:15:54,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:54,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x412827d5 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:15:54,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ebe9c3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:15:54,508 DEBUG [hconnection-0x4cb072fe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:54,509 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43346, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:54,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:15:54,533 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:15:54,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x412827d5 to 127.0.0.1:55996 2023-07-12 08:15:54,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:15:54,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-12 08:15:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:15:54,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:54,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:54,547 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:54,548 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689150354548 2023-07-12 08:15:54,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-12 08:15:54,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:54,549 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:15:54,549 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:15:54,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:54,556 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-12 08:15:54,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 12 msec 2023-07-12 08:15:54,560 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:54,561 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689150354561 2023-07-12 08:15:54,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,619 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-12 08:15:54,619 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:54,620 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-12 08:15:54,620 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-12 08:15:54,621 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,621 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,622 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:54,622 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:54,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:54,622 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,622 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:54,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:54,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:54,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,624 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,624 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-12 08:15:54,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,625 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,625 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:15:54,625 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:54,625 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:54,638 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:54,648 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:54,650 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:54,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:54,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:54,651 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:15:54,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,674 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-12 08:15:54,674 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:15:54,678 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:54,679 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:54,679 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:54,678 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:54,680 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:54,680 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:54,681 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,682 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-12 08:15:54,682 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-12 08:15:54,682 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-12 08:15:54,684 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,684 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:54,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:54,685 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,686 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:54,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:54,687 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,687 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:54,690 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,691 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:15:54,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@383845b7[Count = 1] remaining members to acquire global barrier 2023-07-12 08:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:54,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:54,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-12 08:15:54,698 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@383845b7[Count = 0] remaining members to acquire global barrier 2023-07-12 08:15:54,698 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-12 08:15:54,698 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,702 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,702 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:54,702 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,703 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:54,708 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,708 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-12 08:15:54,708 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:54,708 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:15:54,709 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:54,709 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:54,709 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:15:54,709 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:15:54,709 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:54,709 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:54,709 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. started... 2023-07-12 08:15:54,709 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,709 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 530eb0c473ed47cbe3aacc94c6f874bb 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-12 08:15:54,709 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. started... 2023-07-12 08:15:54,711 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b13613492f5410c481bf7922f607eeef 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-12 08:15:54,714 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,714 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:15:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:54,725 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:54,726 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:54,790 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230712223a174474b94461bc924f74ebbf243e to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712223a174474b94461bc924f74ebbf243e 2023-07-12 08:15:54,803 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712e789ad84361246a09f193992b82d75c4 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712e789ad84361246a09f193992b82d75c4 2023-07-12 08:15:54,819 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/.tmp/cf/5cc4a25bb6c6404298e81593de95c000 2023-07-12 08:15:54,825 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/.tmp/cf/5cc4a25bb6c6404298e81593de95c000 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf/5cc4a25bb6c6404298e81593de95c000 2023-07-12 08:15:54,831 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf/5cc4a25bb6c6404298e81593de95c000, entries=3, sequenceid=6, filesize=5.4 K 2023-07-12 08:15:54,834 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 530eb0c473ed47cbe3aacc94c6f874bb in 125ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:54,834 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-12 08:15:54,835 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 530eb0c473ed47cbe3aacc94c6f874bb: 2023-07-12 08:15:54,835 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,835 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:54,835 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf/5cc4a25bb6c6404298e81593de95c000] hfiles 2023-07-12 08:15:54,835 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf/5cc4a25bb6c6404298e81593de95c000 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,851 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:54,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:54,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:54,853 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:15:54,863 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/.tmp/cf/3a89de1b4f374f11a06a9f295516b00a 2023-07-12 08:15:54,874 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/.tmp/cf/3a89de1b4f374f11a06a9f295516b00a as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf/3a89de1b4f374f11a06a9f295516b00a 2023-07-12 08:15:54,884 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf/3a89de1b4f374f11a06a9f295516b00a, entries=47, sequenceid=6, filesize=13.1 K 2023-07-12 08:15:54,885 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b13613492f5410c481bf7922f607eeef in 174ms, sequenceid=6, compaction requested=false 2023-07-12 08:15:54,888 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b13613492f5410c481bf7922f607eeef: 2023-07-12 08:15:54,888 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,893 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:15:54,893 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf/3a89de1b4f374f11a06a9f295516b00a] hfiles 2023-07-12 08:15:54,893 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf/3a89de1b4f374f11a06a9f295516b00a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,910 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. completed. 2023-07-12 08:15:54,910 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:15:54,910 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:54,910 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:54,910 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,910 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:54,910 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:15:54,912 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:54,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:54,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:54,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,916 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:54,916 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:54,916 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:54,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:15:54,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-12 08:15:54,947 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. completed. 2023-07-12 08:15:54,947 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:15:54,947 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:15:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:15:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-12 08:15:54,948 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:15:54,949 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:54,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:54,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:54,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,952 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-12 08:15:54,952 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:54,952 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-12 08:15:54,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:54,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:15:54,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-12 08:15:54,958 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-12 08:15:54,958 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:15:54,958 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:15:54,958 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,958 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:15:54,960 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,960 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:54,961 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:15:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:15:54,961 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:15:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,961 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:54,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:54,962 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:15:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,963 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,964 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,968 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,968 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,969 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:54,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:54,973 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:15:54,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:15:54,973 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:54,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,974 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-12 08:15:54,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:15:54,974 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:15:54,974 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:54,974 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:15:54,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:15:54,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:15:54,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,976 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:54,976 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:54,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712e789ad84361246a09f193992b82d75c4, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712223a174474b94461bc924f74ebbf243e] mob files 2023-07-12 08:15:54,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712e789ad84361246a09f193992b82d75c4 2023-07-12 08:15:54,977 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712223a174474b94461bc924f74ebbf243e 2023-07-12 08:15:54,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:15:54,977 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-12 08:15:54,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:15:55,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,153 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:55,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:55,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:15:55,155 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:15:55,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-12 08:15:55,214 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,215 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689149754549Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689149755010 (+461 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689149755010Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689149755010Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689149755036 (+26 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689149755085 (+49 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689149755214 (+129 ms) 2023-07-12 08:15:55,220 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-12 08:15:55,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 669 msec 2023-07-12 08:15:55,655 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:15:55,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-12 08:15:55,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:15:55,662 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662 2023-07-12 08:15:55,662 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41579, tgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662, rawTgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:15:55,700 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:15:55,700 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2103653862_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,700 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-12 08:15:55,729 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:15:55,873 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:55,873 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:55,874 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:55,874 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:56,719 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0005_000001 (auth:SIMPLE) 2023-07-12 08:15:57,133 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-1537450923785107427.jar 2023-07-12 08:15:57,134 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,134 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,235 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-1138051717643337624.jar 2023-07-12 08:15:57,236 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,236 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,237 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,237 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:15:57,239 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:15:57,240 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:15:57,240 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:15:57,241 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:15:57,241 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:15:57,242 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:15:57,242 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:15:57,243 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:15:57,243 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:15:57,244 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:15:57,245 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:57,246 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:57,246 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:57,247 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:57,247 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:15:57,248 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:57,249 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:15:57,474 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:15:58,089 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:15:58,092 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-12 08:15:58,244 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:58,244 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:15:58,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0006_000001 (auth:SIMPLE) 2023-07-12 08:16:04,344 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0006_000001 (auth:SIMPLE) 2023-07-12 08:16:07,576 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:16:07,577 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:16:07,583 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:07,584 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:16:07,584 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:16:07,584 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:07,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 08:16:07,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 08:16:07,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:07,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-12 08:16:07,585 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149755662/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-12 08:16:07,590 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:07,595 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149767595"}]},"ts":"1689149767595"} 2023-07-12 08:16:07,596 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-12 08:16:07,598 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-12 08:16:07,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, UNASSIGN}] 2023-07-12 08:16:07,601 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, UNASSIGN 2023-07-12 08:16:07,601 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, UNASSIGN 2023-07-12 08:16:07,601 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b13613492f5410c481bf7922f607eeef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:07,601 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=530eb0c473ed47cbe3aacc94c6f874bb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:07,602 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149767601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149767601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149767601"}]},"ts":"1689149767601"} 2023-07-12 08:16:07,602 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149767601"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149767601"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149767601"}]},"ts":"1689149767601"} 2023-07-12 08:16:07,603 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure b13613492f5410c481bf7922f607eeef, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:16:07,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 530eb0c473ed47cbe3aacc94c6f874bb, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:16:07,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:07,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:16:07,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b13613492f5410c481bf7922f607eeef 2023-07-12 08:16:07,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 530eb0c473ed47cbe3aacc94c6f874bb, disabling compactions & flushes 2023-07-12 08:16:07,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b13613492f5410c481bf7922f607eeef, disabling compactions & flushes 2023-07-12 08:16:07,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:16:07,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:16:07,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:16:07,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:16:07,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. after waiting 0 ms 2023-07-12 08:16:07,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. after waiting 0 ms 2023-07-12 08:16:07,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:16:07,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:16:07,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:07,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:07,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:07,833 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb. 2023-07-12 08:16:07,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 530eb0c473ed47cbe3aacc94c6f874bb: 2023-07-12 08:16:07,833 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:07,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef. 2023-07-12 08:16:07,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b13613492f5410c481bf7922f607eeef: 2023-07-12 08:16:07,836 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:16:07,838 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=530eb0c473ed47cbe3aacc94c6f874bb, regionState=CLOSED 2023-07-12 08:16:07,838 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149767838"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149767838"}]},"ts":"1689149767838"} 2023-07-12 08:16:07,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b13613492f5410c481bf7922f607eeef 2023-07-12 08:16:07,839 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b13613492f5410c481bf7922f607eeef, regionState=CLOSED 2023-07-12 08:16:07,839 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689149767839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149767839"}]},"ts":"1689149767839"} 2023-07-12 08:16:07,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-12 08:16:07,843 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 530eb0c473ed47cbe3aacc94c6f874bb, server=jenkins-hbase4.apache.org,39637,1689149647017 in 237 msec 2023-07-12 08:16:07,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-12 08:16:07,844 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=530eb0c473ed47cbe3aacc94c6f874bb, UNASSIGN in 244 msec 2023-07-12 08:16:07,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure b13613492f5410c481bf7922f607eeef, server=jenkins-hbase4.apache.org,40943,1689149646919 in 239 msec 2023-07-12 08:16:07,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-12 08:16:07,846 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b13613492f5410c481bf7922f607eeef, UNASSIGN in 245 msec 2023-07-12 08:16:07,847 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149767847"}]},"ts":"1689149767847"} 2023-07-12 08:16:07,848 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-12 08:16:07,850 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-12 08:16:07,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 259 msec 2023-07-12 08:16:07,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-12 08:16:07,898 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-12 08:16:07,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,903 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,906 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,909 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef 2023-07-12 08:16:07,909 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:16:07,910 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,910 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,910 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,910 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:07,912 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:07,912 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:07,912 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:07,913 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/recovered.edits] 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:07,913 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:07,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 08:16:07,914 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/recovered.edits] 2023-07-12 08:16:07,920 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf/3a89de1b4f374f11a06a9f295516b00a to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/cf/3a89de1b4f374f11a06a9f295516b00a 2023-07-12 08:16:07,921 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf/5cc4a25bb6c6404298e81593de95c000 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/cf/5cc4a25bb6c6404298e81593de95c000 2023-07-12 08:16:07,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef/recovered.edits/9.seqid 2023-07-12 08:16:07,928 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/b13613492f5410c481bf7922f607eeef 2023-07-12 08:16:07,929 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb/recovered.edits/9.seqid 2023-07-12 08:16:07,929 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testEmptyExportFileSystemState/530eb0c473ed47cbe3aacc94c6f874bb 2023-07-12 08:16:07,929 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-12 08:16:07,930 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 08:16:07,931 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-12 08:16:07,936 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712e789ad84361246a09f193992b82d75c4 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230712e789ad84361246a09f193992b82d75c4 2023-07-12 08:16:07,938 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712223a174474b94461bc924f74ebbf243e to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230712223a174474b94461bc924f74ebbf243e 2023-07-12 08:16:07,939 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-12 08:16:07,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,944 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-12 08:16:07,947 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-12 08:16:07,948 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,948 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-12 08:16:07,948 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149767948"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:07,949 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149767948"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:07,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:16:07,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 530eb0c473ed47cbe3aacc94c6f874bb, NAME => 'testtb-testEmptyExportFileSystemState,,1689149752568.530eb0c473ed47cbe3aacc94c6f874bb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b13613492f5410c481bf7922f607eeef, NAME => 'testtb-testEmptyExportFileSystemState,1,1689149752568.b13613492f5410c481bf7922f607eeef.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:16:07,951 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-12 08:16:07,951 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149767951"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:07,953 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-12 08:16:07,956 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-12 08:16:07,960 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 57 msec 2023-07-12 08:16:08,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-12 08:16:08,015 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-12 08:16:08,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-12 08:16:08,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:08,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-12 08:16:08,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-12 08:16:08,060 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 759) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:44994 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1408667196_1 at /127.0.0.1:37104 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:37118 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:42783 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:55416 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4914 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:38031 from appattempt_1689149656223_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=917 (was 907) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=597 (was 598), ProcessCount=181 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=2200 (was 3011) 2023-07-12 08:16:08,060 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 08:16:08,096 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=917, MaxFileDescriptor=60000, SystemLoadAverage=597, ProcessCount=181, AvailableMemoryMB=2194 2023-07-12 08:16:08,097 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-12 08:16:08,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-12 08:16:08,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:08,104 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-12 08:16:08,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-12 08:16:08,105 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-12 08:16:08,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:08,108 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,108 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,109 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 empty. 2023-07-12 08:16:08,109 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 empty. 2023-07-12 08:16:08,110 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,110 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,110 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 08:16:08,144 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-12 08:16:08,147 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 335d33067c514022b8922a0dcdd96da8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:16:08,152 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2ad5a6844d4d7fd5ab39ac64a11fe0e8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp 2023-07-12 08:16:08,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:08,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:08,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 2ad5a6844d4d7fd5ab39ac64a11fe0e8, disabling compactions & flushes 2023-07-12 08:16:08,223 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. after waiting 0 ms 2023-07-12 08:16:08,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,223 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,223 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 2ad5a6844d4d7fd5ab39ac64a11fe0e8: 2023-07-12 08:16:08,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:08,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 335d33067c514022b8922a0dcdd96da8, disabling compactions & flushes 2023-07-12 08:16:08,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. after waiting 0 ms 2023-07-12 08:16:08,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,227 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,227 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 335d33067c514022b8922a0dcdd96da8: 2023-07-12 08:16:08,230 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-12 08:16:08,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149768231"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149768231"}]},"ts":"1689149768231"} 2023-07-12 08:16:08,231 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149768231"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149768231"}]},"ts":"1689149768231"} 2023-07-12 08:16:08,233 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-12 08:16:08,234 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-12 08:16:08,234 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149768234"}]},"ts":"1689149768234"} 2023-07-12 08:16:08,236 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-12 08:16:08,246 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-12 08:16:08,247 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-12 08:16:08,247 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-12 08:16:08,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-12 08:16:08,248 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-12 08:16:08,248 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, ASSIGN}] 2023-07-12 08:16:08,251 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, ASSIGN 2023-07-12 08:16:08,251 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, ASSIGN 2023-07-12 08:16:08,253 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39637,1689149647017; forceNewPlan=false, retain=false 2023-07-12 08:16:08,254 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40943,1689149646919; forceNewPlan=false, retain=false 2023-07-12 08:16:08,404 INFO [jenkins-hbase4:45535] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-12 08:16:08,408 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2ad5a6844d4d7fd5ab39ac64a11fe0e8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:08,408 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=335d33067c514022b8922a0dcdd96da8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:08,408 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149768408"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149768408"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149768408"}]},"ts":"1689149768408"} 2023-07-12 08:16:08,408 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149768408"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149768408"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149768408"}]},"ts":"1689149768408"} 2023-07-12 08:16:08,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 2ad5a6844d4d7fd5ab39ac64a11fe0e8, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:16:08,411 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 335d33067c514022b8922a0dcdd96da8, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:16:08,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:08,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 335d33067c514022b8922a0dcdd96da8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.', STARTKEY => '', ENDKEY => '1'} 2023-07-12 08:16:08,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. service=AccessControlService 2023-07-12 08:16:08,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:16:08,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:08,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2ad5a6844d4d7fd5ab39ac64a11fe0e8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.', STARTKEY => '1', ENDKEY => ''} 2023-07-12 08:16:08,569 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. service=AccessControlService 2023-07-12 08:16:08,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-12 08:16:08,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-12 08:16:08,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,583 INFO [StoreOpener-335d33067c514022b8922a0dcdd96da8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,586 DEBUG [StoreOpener-335d33067c514022b8922a0dcdd96da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf 2023-07-12 08:16:08,586 DEBUG [StoreOpener-335d33067c514022b8922a0dcdd96da8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf 2023-07-12 08:16:08,587 INFO [StoreOpener-335d33067c514022b8922a0dcdd96da8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 335d33067c514022b8922a0dcdd96da8 columnFamilyName cf 2023-07-12 08:16:08,589 INFO [StoreOpener-2ad5a6844d4d7fd5ab39ac64a11fe0e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,593 INFO [StoreOpener-335d33067c514022b8922a0dcdd96da8-1] regionserver.HStore(310): Store=335d33067c514022b8922a0dcdd96da8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:16:08,594 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:08,602 DEBUG [StoreOpener-2ad5a6844d4d7fd5ab39ac64a11fe0e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf 2023-07-12 08:16:08,602 DEBUG [StoreOpener-2ad5a6844d4d7fd5ab39ac64a11fe0e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf 2023-07-12 08:16:08,603 INFO [StoreOpener-2ad5a6844d4d7fd5ab39ac64a11fe0e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ad5a6844d4d7fd5ab39ac64a11fe0e8 columnFamilyName cf 2023-07-12 08:16:08,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:16:08,604 INFO [StoreOpener-2ad5a6844d4d7fd5ab39ac64a11fe0e8-1] regionserver.HStore(310): Store=2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-12 08:16:08,604 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 335d33067c514022b8922a0dcdd96da8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66942069, jitterRate=-0.00248543918132782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:16:08,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 335d33067c514022b8922a0dcdd96da8: 2023-07-12 08:16:08,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8., pid=109, masterSystemTime=1689149768564 2023-07-12 08:16:08,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,607 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,607 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=335d33067c514022b8922a0dcdd96da8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:08,608 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149768607"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149768607"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149768607"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149768607"}]},"ts":"1689149768607"} 2023-07-12 08:16:08,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-12 08:16:08,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 335d33067c514022b8922a0dcdd96da8, server=jenkins-hbase4.apache.org,40943,1689149646919 in 198 msec 2023-07-12 08:16:08,612 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:08,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, ASSIGN in 363 msec 2023-07-12 08:16:08,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-12 08:16:08,620 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2ad5a6844d4d7fd5ab39ac64a11fe0e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72025746, jitterRate=0.07326725125312805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-12 08:16:08,620 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2ad5a6844d4d7fd5ab39ac64a11fe0e8: 2023-07-12 08:16:08,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8., pid=108, masterSystemTime=1689149768564 2023-07-12 08:16:08,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:08,632 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=2ad5a6844d4d7fd5ab39ac64a11fe0e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:08,633 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149768632"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689149768632"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689149768632"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689149768632"}]},"ts":"1689149768632"} 2023-07-12 08:16:08,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-12 08:16:08,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 2ad5a6844d4d7fd5ab39ac64a11fe0e8, server=jenkins-hbase4.apache.org,39637,1689149647017 in 224 msec 2023-07-12 08:16:08,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-12 08:16:08,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, ASSIGN in 388 msec 2023-07-12 08:16:08,639 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-12 08:16:08,639 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149768639"}]},"ts":"1689149768639"} 2023-07-12 08:16:08,641 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-12 08:16:08,643 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-12 08:16:08,643 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-12 08:16:08,644 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 08:16:08,646 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:08,646 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:08,646 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:08,646 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:08,648 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:08,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:08,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:08,649 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-12 08:16:08,659 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 558 msec 2023-07-12 08:16:08,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-12 08:16:08,714 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-12 08:16:08,733 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:08,734 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:08,736 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:16:08,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:08,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149768824 (current time:1689149768824). 2023-07-12 08:16:08,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:16:08,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x2f553b22 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:08,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@182c436a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:08,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:08,869 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:08,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f553b22 to 127.0.0.1:55996 2023-07-12 08:16:08,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:08,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x08b2a453 to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:08,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e38124c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:08,910 DEBUG [hconnection-0x74f527f2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:08,924 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:08,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:08,938 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:08,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08b2a453 to 127.0.0.1:55996 2023-07-12 08:16:08,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:08,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 08:16:08,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:16:08,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:08,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:08,944 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:08,945 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689150368945 2023-07-12 08:16:08,945 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:08,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:08,947 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:16:08,947 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:16:08,949 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:08,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:08,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-12 08:16:08,952 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:08,953 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689150368953 2023-07-12 08:16:09,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,007 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 08:16:09,007 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,009 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 08:16:09,009 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 08:16:09,009 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,009 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,012 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,012 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,012 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,012 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,013 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,013 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,014 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,014 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:16:09,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 08:16:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 08:16:09,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,016 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:09,016 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-12 08:16:09,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,017 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:09,022 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:09,023 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,031 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,031 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:09,046 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:09,046 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:09,046 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:09,047 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:09,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:09,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:09,046 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,049 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:16:09,049 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:09,055 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,052 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,057 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:09,059 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,059 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,059 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:09,060 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,063 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,063 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,063 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,063 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641f7658[Count = 1] remaining members to acquire global barrier 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:09,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@641f7658[Count = 0] remaining members to acquire global barrier 2023-07-12 08:16:09,073 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 08:16:09,073 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,074 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,074 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,074 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:09,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:09,075 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,077 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:09,077 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:09,077 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:09,077 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. started... 2023-07-12 08:16:09,077 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,077 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:16:09,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,078 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:09,077 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 335d33067c514022b8922a0dcdd96da8: 2023-07-12 08:16:09,075 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:16:09,078 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,078 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:09,078 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:16:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:09,080 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:09,087 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:09,088 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:09,098 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:09,099 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. started... 2023-07-12 08:16:09,100 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ad5a6844d4d7fd5ab39ac64a11fe0e8: 2023-07-12 08:16:09,100 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,101 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:09,101 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-12 08:16:09,112 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. completed. 2023-07-12 08:16:09,112 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:09,112 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:16:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:09,114 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:09,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,114 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:16:09,120 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 08:16:09,123 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. completed. 2023-07-12 08:16:09,123 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:09,123 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:09,123 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:09,123 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,123 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:09,123 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:16:09,127 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,127 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:09,127 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:09,127 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:09,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:16:09,134 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 08:16:09,134 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 08:16:09,134 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:16:09,134 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:16:09,134 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,134 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:09,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:09,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:09,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:09,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:09,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:09,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:09,138 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:09,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,139 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,140 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,142 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,143 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,143 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:09,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,147 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,149 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:09,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,147 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:09,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:09,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:16:09,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:09,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:09,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,151 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-12 08:16:09,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:09,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:09,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,175 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,218 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,249 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:09,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:09,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:09,251 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:16:09,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 08:16:09,276 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,276 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689149768945Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689149769174 (+229 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149769174Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149769174Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149769182 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689149769212 (+30 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689149769276 (+64 ms) 2023-07-12 08:16:09,280 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:09,283 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 333 msec 2023-07-12 08:16:09,551 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:09,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:09,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:16:09,581 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40943] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:16:09,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39637] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. with WAL disabled. Data may be lost in the event of a crash. 2023-07-12 08:16:09,586 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,586 DEBUG [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:09,586 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-12 08:16:09,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689149769599 (current time:1689149769599). 2023-07-12 08:16:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-12 08:16:09,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x6b3f69be to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:09,600 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-12 08:16:09,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3628099c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:09,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:09,640 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39868, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:09,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6b3f69be to 127.0.0.1:55996 2023-07-12 08:16:09,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:09,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(139): Connect 0x460ecd7f to 127.0.0.1:55996 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-12 08:16:09,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@566c2e99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-12 08:16:09,749 DEBUG [hconnection-0x207ea921-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:09,754 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:09,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-12 08:16:09,762 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-12 08:16:09,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x460ecd7f to 127.0.0.1:55996 2023-07-12 08:16:09,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:09,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-12 08:16:09,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-12 08:16:09,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:09,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:09,769 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:09,773 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689150369773 2023-07-12 08:16:09,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-12 08:16:09,774 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,774 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-12 08:16:09,774 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-12 08:16:09,777 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-12 08:16:09,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:09,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-12 08:16:09,780 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:09,781 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689150369781 2023-07-12 08:16:09,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,820 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-12 08:16:09,820 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,822 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-12 08:16:09,822 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-12 08:16:09,823 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,823 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,824 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,824 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,824 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,824 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:09,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,826 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,826 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:09,827 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,827 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,827 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-12 08:16:09,829 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,829 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:09,829 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,831 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:09,831 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:09,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,831 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:09,831 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,831 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-12 08:16:09,832 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-12 08:16:09,831 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43379,1689149646981' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:09,833 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:09,833 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:09,833 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:09,833 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-12 08:16:09,833 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-12 08:16:09,834 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-12 08:16:09,836 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,837 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:09,837 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-12 08:16:09,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40943,1689149646919' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314fb633[Count = 1] remaining members to acquire global barrier 2023-07-12 08:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:09,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39637,1689149647017' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-12 08:16:09,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@314fb633[Count = 0] remaining members to acquire global barrier 2023-07-12 08:16:09,845 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-12 08:16:09,845 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:09,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,858 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:09,858 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:09,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:09,858 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-12 08:16:09,858 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:09,858 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43379,1689149646981' in zk 2023-07-12 08:16:09,858 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:09,858 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-12 08:16:09,860 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:09,860 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:09,860 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:09,860 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. started... 2023-07-12 08:16:09,860 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 335d33067c514022b8922a0dcdd96da8 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-12 08:16:09,861 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-12 08:16:09,861 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-12 08:16:09,861 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:09,861 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. started... 2023-07-12 08:16:09,861 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2ad5a6844d4d7fd5ab39ac64a11fe0e8 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-12 08:16:09,863 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:09,863 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:09,863 DEBUG [member: 'jenkins-hbase4.apache.org,43379,1689149646981' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:09,874 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:09,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:09,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:09,876 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-12 08:16:09,956 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307121de79cece1cc43d5b8b60b305462fea1 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307121de79cece1cc43d5b8b60b305462fea1 2023-07-12 08:16:09,991 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230712d8b3887b69a743418ae8164a0c2e4b1e to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712d8b3887b69a743418ae8164a0c2e4b1e 2023-07-12 08:16:10,023 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/.tmp/cf/0e36c2930db14d7a9fd95ce69c73845d 2023-07-12 08:16:10,029 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/.tmp/cf/0e36c2930db14d7a9fd95ce69c73845d as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf/0e36c2930db14d7a9fd95ce69c73845d 2023-07-12 08:16:10,049 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf/0e36c2930db14d7a9fd95ce69c73845d, entries=4, sequenceid=6, filesize=5.6 K 2023-07-12 08:16:10,053 INFO [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 335d33067c514022b8922a0dcdd96da8 in 193ms, sequenceid=6, compaction requested=false 2023-07-12 08:16:10,063 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 335d33067c514022b8922a0dcdd96da8: 2023-07-12 08:16:10,063 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,063 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:10,063 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf/0e36c2930db14d7a9fd95ce69c73845d] hfiles 2023-07-12 08:16:10,063 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf/0e36c2930db14d7a9fd95ce69c73845d for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,067 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/.tmp/cf/962bab6814c74631a48d9f584dba0276 2023-07-12 08:16:10,076 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:10,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:10,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:10,077 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-12 08:16:10,082 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/.tmp/cf/962bab6814c74631a48d9f584dba0276 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf/962bab6814c74631a48d9f584dba0276 2023-07-12 08:16:10,088 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf/962bab6814c74631a48d9f584dba0276, entries=46, sequenceid=6, filesize=13.2 K 2023-07-12 08:16:10,089 INFO [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 2ad5a6844d4d7fd5ab39ac64a11fe0e8 in 227ms, sequenceid=6, compaction requested=false 2023-07-12 08:16:10,089 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2ad5a6844d4d7fd5ab39ac64a11fe0e8: 2023-07-12 08:16:10,089 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,089 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-12 08:16:10,089 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf/962bab6814c74631a48d9f584dba0276] hfiles 2023-07-12 08:16:10,089 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf/962bab6814c74631a48d9f584dba0276 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,094 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. completed. 2023-07-12 08:16:10,094 DEBUG [rs(jenkins-hbase4.apache.org,40943,1689149646919)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:10,094 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:10,094 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:10,094 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,094 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:10,094 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40943,1689149646919' in zk 2023-07-12 08:16:10,096 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,096 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,096 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:10,096 DEBUG [member: 'jenkins-hbase4.apache.org,40943,1689149646919' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:10,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40943,1689149646919': 2023-07-12 08:16:10,118 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40943,1689149646919' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-12 08:16:10,118 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. completed. 2023-07-12 08:16:10,118 DEBUG [rs(jenkins-hbase4.apache.org,39637,1689149647017)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-12 08:16:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-12 08:16:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-12 08:16:10,118 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39637,1689149647017' in zk 2023-07-12 08:16:10,121 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-12 08:16:10,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:10,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,39637,1689149647017' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-12 08:16:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:10,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39637,1689149647017': 2023-07-12 08:16:10,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39637,1689149647017' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-12 08:16:10,129 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-12 08:16:10,129 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-12 08:16:10,129 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-12 08:16:10,129 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,130 INFO [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:10,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-12 08:16:10,132 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:10,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:10,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:10,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:10,133 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:10,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,135 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-12 08:16:10,135 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,138 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-12 08:16:10,138 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,139 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:10,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:10,147 DEBUG [(jenkins-hbase4.apache.org,45535,1689149645355)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-12 08:16:10,149 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:10,147 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,146 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:10,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-12 08:16:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-12 08:16:10,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:10,149 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,149 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,149 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-12 08:16:10,149 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:10,149 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:10,149 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:10,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-12 08:16:10,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-12 08:16:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-12 08:16:10,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:10,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:10,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,150 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712d8b3887b69a743418ae8164a0c2e4b1e, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307121de79cece1cc43d5b8b60b305462fea1] mob files 2023-07-12 08:16:10,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712d8b3887b69a743418ae8164a0c2e4b1e 2023-07-12 08:16:10,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307121de79cece1cc43d5b8b60b305462fea1 2023-07-12 08:16:10,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,332 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,377 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:10,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:10,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-12 08:16:10,379 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-12 08:16:10,517 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-12 08:16:10,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,518 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689149769774Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689149770179 (+405 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689149770179Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689149770180 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689149770213 (+33 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689149770301 (+88 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689149770517 (+216 ms) 2023-07-12 08:16:10,522 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-12 08:16:10,523 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 747 msec 2023-07-12 08:16:10,879 DEBUG [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-12 08:16:10,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-12 08:16:10,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-12 08:16:10,881 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881 2023-07-12 08:16:10,881 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:41579, tgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881, rawTgtDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881, srcFsUri=hdfs://localhost:41579, srcDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:16:10,908 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42 2023-07-12 08:16:10,908 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_36849628_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,908 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:41579, inputRoot=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42, snapshotDir=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-12 08:16:10,931 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:10,996 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:10,996 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:10,997 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:10,997 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:11,707 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0006_000001 (auth:SIMPLE) 2023-07-12 08:16:12,320 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-7925613251679869170.jar 2023-07-12 08:16:12,321 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,321 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,420 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/hadoop-4949535110030602177.jar 2023-07-12 08:16:12,421 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,421 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,422 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,423 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,423 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,423 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-12 08:16:12,424 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-12 08:16:12,425 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-12 08:16:12,425 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-12 08:16:12,426 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-12 08:16:12,426 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-12 08:16:12,427 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-12 08:16:12,427 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-12 08:16:12,428 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-12 08:16:12,428 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-12 08:16:12,429 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-12 08:16:12,430 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:12,430 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:12,431 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:16:12,431 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:12,432 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-12 08:16:12,432 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:16:12,433 DEBUG [Listener at jenkins-hbase4.apache.org/35773] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-12 08:16:13,489 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:16:13,867 WARN [DataStreamer for file /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1689149656223_0007/libjars/hbase-procedure-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-12 08:16:13,868 WARN [Listener at jenkins-hbase4.apache.org/35773] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-12 08:16:13,871 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-12 08:16:13,874 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-12 08:16:14,069 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:16:14,069 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-12 08:16:14,718 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:20,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:22,788 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:26,145 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689149656223_0007_000001 (auth:SIMPLE) 2023-07-12 08:16:27,225 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-12 08:16:27,225 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-12 08:16:27,236 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,236 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-12 08:16:27,237 INFO [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-12 08:16:27,237 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 08:16:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 08:16:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2000515944_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-12 08:16:27,238 DEBUG [Listener at jenkins-hbase4.apache.org/35773] snapshot.TestExportSnapshot(367): hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/export-test/export-1689149770881/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-12 08:16:27,244 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 08:16:27,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149787248"}]},"ts":"1689149787248"} 2023-07-12 08:16:27,249 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-12 08:16:27,250 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-12 08:16:27,251 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, UNASSIGN}] 2023-07-12 08:16:27,253 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, UNASSIGN 2023-07-12 08:16:27,253 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, UNASSIGN 2023-07-12 08:16:27,254 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=335d33067c514022b8922a0dcdd96da8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:27,254 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2ad5a6844d4d7fd5ab39ac64a11fe0e8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:27,254 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149787253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149787253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149787253"}]},"ts":"1689149787253"} 2023-07-12 08:16:27,254 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149787253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689149787253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689149787253"}]},"ts":"1689149787253"} 2023-07-12 08:16:27,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 2ad5a6844d4d7fd5ab39ac64a11fe0e8, server=jenkins-hbase4.apache.org,39637,1689149647017}] 2023-07-12 08:16:27,256 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 335d33067c514022b8922a0dcdd96da8, server=jenkins-hbase4.apache.org,40943,1689149646919}] 2023-07-12 08:16:27,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 08:16:27,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:27,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2ad5a6844d4d7fd5ab39ac64a11fe0e8, disabling compactions & flushes 2023-07-12 08:16:27,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:27,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:27,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. after waiting 0 ms 2023-07-12 08:16:27,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:27,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:27,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 335d33067c514022b8922a0dcdd96da8, disabling compactions & flushes 2023-07-12 08:16:27,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:27,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:27,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. after waiting 0 ms 2023-07-12 08:16:27,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:27,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:27,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:27,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:27,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:27,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8. 2023-07-12 08:16:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 335d33067c514022b8922a0dcdd96da8: 2023-07-12 08:16:27,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8. 2023-07-12 08:16:27,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2ad5a6844d4d7fd5ab39ac64a11fe0e8: 2023-07-12 08:16:27,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:27,424 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=2ad5a6844d4d7fd5ab39ac64a11fe0e8, regionState=CLOSED 2023-07-12 08:16:27,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:27,424 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149787423"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149787423"}]},"ts":"1689149787423"} 2023-07-12 08:16:27,424 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=335d33067c514022b8922a0dcdd96da8, regionState=CLOSED 2023-07-12 08:16:27,424 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689149787424"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689149787424"}]},"ts":"1689149787424"} 2023-07-12 08:16:27,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-12 08:16:27,430 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 2ad5a6844d4d7fd5ab39ac64a11fe0e8, server=jenkins-hbase4.apache.org,39637,1689149647017 in 170 msec 2023-07-12 08:16:27,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-12 08:16:27,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=2ad5a6844d4d7fd5ab39ac64a11fe0e8, UNASSIGN in 179 msec 2023-07-12 08:16:27,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 335d33067c514022b8922a0dcdd96da8, server=jenkins-hbase4.apache.org,40943,1689149646919 in 170 msec 2023-07-12 08:16:27,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-12 08:16:27,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=335d33067c514022b8922a0dcdd96da8, UNASSIGN in 180 msec 2023-07-12 08:16:27,434 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689149787433"}]},"ts":"1689149787433"} 2023-07-12 08:16:27,435 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-12 08:16:27,436 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-12 08:16:27,438 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 193 msec 2023-07-12 08:16:27,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-12 08:16:27,550 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-12 08:16:27,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,555 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,556 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,557 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43379] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,561 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,562 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:27,563 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:27,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:27,563 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:27,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:27,565 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-12 08:16:27,566 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,566 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,566 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:27,566 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:27,566 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,567 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:27,567 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,567 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-12 08:16:27,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 08:16:27,568 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/recovered.edits] 2023-07-12 08:16:27,568 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf, FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/recovered.edits] 2023-07-12 08:16:27,573 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf/962bab6814c74631a48d9f584dba0276 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/cf/962bab6814c74631a48d9f584dba0276 2023-07-12 08:16:27,573 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf/0e36c2930db14d7a9fd95ce69c73845d to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/cf/0e36c2930db14d7a9fd95ce69c73845d 2023-07-12 08:16:27,577 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8/recovered.edits/9.seqid 2023-07-12 08:16:27,577 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/recovered.edits/9.seqid to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8/recovered.edits/9.seqid 2023-07-12 08:16:27,577 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/335d33067c514022b8922a0dcdd96da8 2023-07-12 08:16:27,577 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/2ad5a6844d4d7fd5ab39ac64a11fe0e8 2023-07-12 08:16:27,577 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-12 08:16:27,578 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 08:16:27,578 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-12 08:16:27,582 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712d8b3887b69a743418ae8164a0c2e4b1e to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230712d8b3887b69a743418ae8164a0c2e4b1e 2023-07-12 08:16:27,583 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307121de79cece1cc43d5b8b60b305462fea1 to hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307121de79cece1cc43d5b8b60b305462fea1 2023-07-12 08:16:27,583 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-12 08:16:27,585 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,587 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-12 08:16:27,589 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-12 08:16:27,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-12 08:16:27,590 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149787590"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:27,590 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689149787590"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:27,592 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-12 08:16:27,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 335d33067c514022b8922a0dcdd96da8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689149768098.335d33067c514022b8922a0dcdd96da8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2ad5a6844d4d7fd5ab39ac64a11fe0e8, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689149768098.2ad5a6844d4d7fd5ab39ac64a11fe0e8.', STARTKEY => '1', ENDKEY => ''}] 2023-07-12 08:16:27,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-12 08:16:27,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689149787592"}]},"ts":"9223372036854775807"} 2023-07-12 08:16:27,594 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-12 08:16:27,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 45 msec 2023-07-12 08:16:27,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-12 08:16:27,668 INFO [Listener at jenkins-hbase4.apache.org/35773] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-12 08:16:27,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 08:16:27,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-12 08:16:27,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45535] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-12 08:16:27,704 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 760) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:35332 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:41623 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:49426 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2000515944_17 at /127.0.0.1:33620 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_590673796_1 at /127.0.0.1:49412 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x1aa22286-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5555 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_590673796_1 at /127.0.0.1:35300 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=897 (was 917), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=717 (was 597) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 181), AvailableMemoryMB=2252 (was 2194) - AvailableMemoryMB LEAK? - 2023-07-12 08:16:27,704 WARN [Listener at jenkins-hbase4.apache.org/35773] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-12 08:16:27,704 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-12 08:16:27,716 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:27,830 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689149656223_0007_01_000001 is : 143 2023-07-12 08:16:32,998 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-12 08:16:41,846 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:55,967 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 08:16:55,968 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:56,077 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-12 08:16:56,087 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-12 08:16:56,088 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 08:16:56,100 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-12 08:16:56,203 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-12 08:16:56,203 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-12 08:16:56,203 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-12 08:16:56,203 INFO [Listener at jenkins-hbase4.apache.org/35773] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-12 08:16:56,203 DEBUG [Listener at jenkins-hbase4.apache.org/35773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39a9e5ab to 127.0.0.1:55996 2023-07-12 08:16:56,203 DEBUG [Listener at jenkins-hbase4.apache.org/35773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,204 DEBUG [Listener at jenkins-hbase4.apache.org/35773] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-12 08:16:56,204 DEBUG [Listener at jenkins-hbase4.apache.org/35773] util.JVMClusterUtil(257): Found active master hash=1878016116, stopped=false 2023-07-12 08:16:56,204 DEBUG [Listener at jenkins-hbase4.apache.org/35773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,204 DEBUG [Listener at jenkins-hbase4.apache.org/35773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-12 08:16:56,204 INFO [Listener at jenkins-hbase4.apache.org/35773] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:16:56,205 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:56,205 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:56,206 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:56,206 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:16:56,206 INFO [Listener at jenkins-hbase4.apache.org/35773] procedure2.ProcedureExecutor(629): Stopping 2023-07-12 08:16:56,206 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-12 08:16:56,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:56,206 DEBUG [Listener at jenkins-hbase4.apache.org/35773] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26336b82 to 127.0.0.1:55996 2023-07-12 08:16:56,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:56,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:56,206 DEBUG [Listener at jenkins-hbase4.apache.org/35773] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,207 INFO [Listener at jenkins-hbase4.apache.org/35773] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40943,1689149646919' ***** 2023-07-12 08:16:56,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-12 08:16:56,207 DEBUG [Listener at jenkins-hbase4.apache.org/35773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,207 INFO [Listener at jenkins-hbase4.apache.org/35773] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 08:16:56,207 INFO [Listener at jenkins-hbase4.apache.org/35773] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43379,1689149646981' ***** 2023-07-12 08:16:56,207 DEBUG [Listener at jenkins-hbase4.apache.org/35773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,207 INFO [Listener at jenkins-hbase4.apache.org/35773] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 08:16:56,207 INFO [RS:0;jenkins-hbase4:40943] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 08:16:56,207 INFO [Listener at jenkins-hbase4.apache.org/35773] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39637,1689149647017' ***** 2023-07-12 08:16:56,208 INFO [RS:1;jenkins-hbase4:43379] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 08:16:56,208 INFO [RS:0;jenkins-hbase4:40943] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 08:16:56,208 INFO [RS:1;jenkins-hbase4:43379] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 08:16:56,208 INFO [RS:0;jenkins-hbase4:40943] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 08:16:56,208 INFO [RS:1;jenkins-hbase4:43379] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 08:16:56,208 DEBUG [Listener at jenkins-hbase4.apache.org/35773] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,208 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 08:16:56,208 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(3305): Received CLOSE for 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:16:56,208 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(3305): Received CLOSE for 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:16:56,208 INFO [Listener at jenkins-hbase4.apache.org/35773] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-12 08:16:56,208 INFO [RS:2;jenkins-hbase4:39637] regionserver.HeapMemoryManager(220): Stopping 2023-07-12 08:16:56,208 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 08:16:56,208 INFO [RS:2;jenkins-hbase4:39637] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-12 08:16:56,208 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:56,208 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:56,209 DEBUG [RS:0;jenkins-hbase4:40943] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01fd1575 to 127.0.0.1:55996 2023-07-12 08:16:56,209 DEBUG [RS:1;jenkins-hbase4:43379] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01840301 to 127.0.0.1:55996 2023-07-12 08:16:56,209 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 88083edd14c6143fb6576172bcb0e04c, disabling compactions & flushes 2023-07-12 08:16:56,208 INFO [RS:2;jenkins-hbase4:39637] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-12 08:16:56,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:16:56,208 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-12 08:16:56,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:16:56,210 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:56,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. after waiting 0 ms 2023-07-12 08:16:56,210 DEBUG [RS:1;jenkins-hbase4:43379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,210 DEBUG [RS:0;jenkins-hbase4:40943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1ce0e83033c63e3981be4286bb8737ba, disabling compactions & flushes 2023-07-12 08:16:56,213 INFO [RS:0;jenkins-hbase4:40943] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 08:16:56,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:16:56,213 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-12 08:16:56,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:16:56,210 DEBUG [RS:2;jenkins-hbase4:39637] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fd7b187 to 127.0.0.1:55996 2023-07-12 08:16:56,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 88083edd14c6143fb6576172bcb0e04c 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-12 08:16:56,213 DEBUG [RS:2;jenkins-hbase4:39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,213 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1478): Online Regions={1ce0e83033c63e3981be4286bb8737ba=hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba.} 2023-07-12 08:16:56,214 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39637,1689149647017; all regions closed. 2023-07-12 08:16:56,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:16:56,213 INFO [RS:0;jenkins-hbase4:40943] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 08:16:56,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. after waiting 0 ms 2023-07-12 08:16:56,214 INFO [RS:0;jenkins-hbase4:40943] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 08:16:56,214 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-12 08:16:56,214 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-12 08:16:56,214 DEBUG [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1504): Waiting on 1ce0e83033c63e3981be4286bb8737ba 2023-07-12 08:16:56,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:16:56,215 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, 88083edd14c6143fb6576172bcb0e04c=hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c.} 2023-07-12 08:16:56,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-12 08:16:56,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1ce0e83033c63e3981be4286bb8737ba 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-12 08:16:56,215 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-12 08:16:56,215 DEBUG [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1504): Waiting on 1588230740, 88083edd14c6143fb6576172bcb0e04c 2023-07-12 08:16:56,215 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-12 08:16:56,216 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-12 08:16:56,216 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-12 08:16:56,216 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-12 08:16:56,233 DEBUG [RS:2;jenkins-hbase4:39637] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs 2023-07-12 08:16:56,233 INFO [RS:2;jenkins-hbase4:39637] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39637%2C1689149647017:(num 1689149649265) 2023-07-12 08:16:56,233 DEBUG [RS:2;jenkins-hbase4:39637] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,233 INFO [RS:2;jenkins-hbase4:39637] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:56,234 INFO [RS:2;jenkins-hbase4:39637] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 08:16:56,234 INFO [RS:2;jenkins-hbase4:39637] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 08:16:56,234 INFO [RS:2;jenkins-hbase4:39637] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 08:16:56,234 INFO [RS:2;jenkins-hbase4:39637] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 08:16:56,234 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:56,235 INFO [RS:2;jenkins-hbase4:39637] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39637 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39637,1689149647017 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:56,252 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:56,255 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39637,1689149647017] 2023-07-12 08:16:56,256 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39637,1689149647017; numProcessing=1 2023-07-12 08:16:56,262 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39637,1689149647017 already deleted, retry=false 2023-07-12 08:16:56,263 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39637,1689149647017 expired; onlineServers=2 2023-07-12 08:16:56,264 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:56,264 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:56,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/.tmp/info/8c1eb5fb360b4349ad6862abbe1d7faa 2023-07-12 08:16:56,267 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:56,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/.tmp/l/f1792b0f214b41beb6119f87b8e008fa 2023-07-12 08:16:56,270 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/.tmp/info/1a0ba6322a15454797dd5aaa81380ebb 2023-07-12 08:16:56,275 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/.tmp/info/8c1eb5fb360b4349ad6862abbe1d7faa as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/info/8c1eb5fb360b4349ad6862abbe1d7faa 2023-07-12 08:16:56,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1792b0f214b41beb6119f87b8e008fa 2023-07-12 08:16:56,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/.tmp/l/f1792b0f214b41beb6119f87b8e008fa as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/l/f1792b0f214b41beb6119f87b8e008fa 2023-07-12 08:16:56,293 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a0ba6322a15454797dd5aaa81380ebb 2023-07-12 08:16:56,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/info/8c1eb5fb360b4349ad6862abbe1d7faa, entries=2, sequenceid=6, filesize=4.8 K 2023-07-12 08:16:56,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 88083edd14c6143fb6576172bcb0e04c in 81ms, sequenceid=6, compaction requested=false 2023-07-12 08:16:56,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f1792b0f214b41beb6119f87b8e008fa 2023-07-12 08:16:56,297 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/l/f1792b0f214b41beb6119f87b8e008fa, entries=7, sequenceid=18, filesize=5.2 K 2023-07-12 08:16:56,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1ce0e83033c63e3981be4286bb8737ba in 83ms, sequenceid=18, compaction requested=false 2023-07-12 08:16:56,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/acl/1ce0e83033c63e3981be4286bb8737ba/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-12 08:16:56,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/namespace/88083edd14c6143fb6576172bcb0e04c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-12 08:16:56,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:16:56,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:16:56,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 88083edd14c6143fb6576172bcb0e04c: 2023-07-12 08:16:56,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1ce0e83033c63e3981be4286bb8737ba: 2023-07-12 08:16:56,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689149650654.1ce0e83033c63e3981be4286bb8737ba. 2023-07-12 08:16:56,324 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689149649908.88083edd14c6143fb6576172bcb0e04c. 2023-07-12 08:16:56,334 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/.tmp/rep_barrier/407e03e9d4434b7dba69f71dd11ca700 2023-07-12 08:16:56,340 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 407e03e9d4434b7dba69f71dd11ca700 2023-07-12 08:16:56,360 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,360 INFO [RS:2;jenkins-hbase4:39637] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39637,1689149647017; zookeeper connection closed. 2023-07-12 08:16:56,360 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:39637-0x1015898a12d0003, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,360 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1f2abb08] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1f2abb08 2023-07-12 08:16:56,365 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/.tmp/table/f3ae7d00b6304bc4b9e9c17fbbdff15c 2023-07-12 08:16:56,370 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3ae7d00b6304bc4b9e9c17fbbdff15c 2023-07-12 08:16:56,371 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/.tmp/info/1a0ba6322a15454797dd5aaa81380ebb as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/info/1a0ba6322a15454797dd5aaa81380ebb 2023-07-12 08:16:56,377 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1a0ba6322a15454797dd5aaa81380ebb 2023-07-12 08:16:56,377 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/info/1a0ba6322a15454797dd5aaa81380ebb, entries=48, sequenceid=131, filesize=10.3 K 2023-07-12 08:16:56,378 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/.tmp/rep_barrier/407e03e9d4434b7dba69f71dd11ca700 as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/rep_barrier/407e03e9d4434b7dba69f71dd11ca700 2023-07-12 08:16:56,382 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 407e03e9d4434b7dba69f71dd11ca700 2023-07-12 08:16:56,382 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/rep_barrier/407e03e9d4434b7dba69f71dd11ca700, entries=13, sequenceid=131, filesize=6.4 K 2023-07-12 08:16:56,383 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/.tmp/table/f3ae7d00b6304bc4b9e9c17fbbdff15c as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/table/f3ae7d00b6304bc4b9e9c17fbbdff15c 2023-07-12 08:16:56,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3ae7d00b6304bc4b9e9c17fbbdff15c 2023-07-12 08:16:56,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/table/f3ae7d00b6304bc4b9e9c17fbbdff15c, entries=24, sequenceid=131, filesize=6.9 K 2023-07-12 08:16:56,388 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 172ms, sequenceid=131, compaction requested=false 2023-07-12 08:16:56,407 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-12 08:16:56,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-12 08:16:56,408 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-12 08:16:56,409 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-12 08:16:56,409 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-12 08:16:56,409 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-12 08:16:56,415 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43379,1689149646981; all regions closed. 2023-07-12 08:16:56,415 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40943,1689149646919; all regions closed. 2023-07-12 08:16:56,425 DEBUG [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs 2023-07-12 08:16:56,425 INFO [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40943%2C1689149646919.meta:.meta(num 1689149649494) 2023-07-12 08:16:56,425 DEBUG [RS:1;jenkins-hbase4:43379] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs 2023-07-12 08:16:56,425 INFO [RS:1;jenkins-hbase4:43379] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43379%2C1689149646981:(num 1689149649256) 2023-07-12 08:16:56,425 DEBUG [RS:1;jenkins-hbase4:43379] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,425 INFO [RS:1;jenkins-hbase4:43379] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:56,425 INFO [RS:1;jenkins-hbase4:43379] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 08:16:56,426 INFO [RS:1;jenkins-hbase4:43379] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-12 08:16:56,426 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:56,426 INFO [RS:1;jenkins-hbase4:43379] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-12 08:16:56,426 INFO [RS:1;jenkins-hbase4:43379] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-12 08:16:56,430 INFO [RS:1;jenkins-hbase4:43379] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43379 2023-07-12 08:16:56,431 DEBUG [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/oldWALs 2023-07-12 08:16:56,431 INFO [RS:0;jenkins-hbase4:40943] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40943%2C1689149646919:(num 1689149649260) 2023-07-12 08:16:56,431 DEBUG [RS:0;jenkins-hbase4:40943] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,431 INFO [RS:0;jenkins-hbase4:40943] regionserver.LeaseManager(133): Closed leases 2023-07-12 08:16:56,431 INFO [RS:0;jenkins-hbase4:40943] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-12 08:16:56,431 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:56,432 INFO [RS:0;jenkins-hbase4:40943] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40943 2023-07-12 08:16:56,432 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-12 08:16:56,432 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:56,432 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43379,1689149646981 2023-07-12 08:16:56,433 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:56,433 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40943,1689149646919 2023-07-12 08:16:56,435 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43379,1689149646981] 2023-07-12 08:16:56,435 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43379,1689149646981; numProcessing=2 2023-07-12 08:16:56,437 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43379,1689149646981 already deleted, retry=false 2023-07-12 08:16:56,437 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43379,1689149646981 expired; onlineServers=1 2023-07-12 08:16:56,437 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40943,1689149646919] 2023-07-12 08:16:56,437 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40943,1689149646919; numProcessing=3 2023-07-12 08:16:56,438 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40943,1689149646919 already deleted, retry=false 2023-07-12 08:16:56,438 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40943,1689149646919 expired; onlineServers=0 2023-07-12 08:16:56,438 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,45535,1689149645355' ***** 2023-07-12 08:16:56,438 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-12 08:16:56,438 DEBUG [M:0;jenkins-hbase4:45535] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ecd4a4f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-12 08:16:56,438 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,45535,1689149645355 2023-07-12 08:16:56,438 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,45535,1689149645355; all regions closed. 2023-07-12 08:16:56,438 DEBUG [M:0;jenkins-hbase4:45535] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-12 08:16:56,439 DEBUG [M:0;jenkins-hbase4:45535] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-12 08:16:56,439 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-12 08:16:56,439 DEBUG [M:0;jenkins-hbase4:45535] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-12 08:16:56,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689149648667] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689149648667,5,FailOnTimeoutGroup] 2023-07-12 08:16:56,439 INFO [M:0;jenkins-hbase4:45535] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-12 08:16:56,439 INFO [M:0;jenkins-hbase4:45535] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-12 08:16:56,439 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689149648675] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689149648675,5,FailOnTimeoutGroup] 2023-07-12 08:16:56,439 INFO [M:0;jenkins-hbase4:45535] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-12 08:16:56,439 DEBUG [M:0;jenkins-hbase4:45535] master.HMaster(1512): Stopping service threads 2023-07-12 08:16:56,439 INFO [M:0;jenkins-hbase4:45535] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-12 08:16:56,440 ERROR [M:0;jenkins-hbase4:45535] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-12 08:16:56,440 INFO [M:0;jenkins-hbase4:45535] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-12 08:16:56,440 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-12 08:16:56,441 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-12 08:16:56,441 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-12 08:16:56,441 DEBUG [M:0;jenkins-hbase4:45535] zookeeper.ZKUtil(398): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-12 08:16:56,441 WARN [M:0;jenkins-hbase4:45535] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-12 08:16:56,441 INFO [M:0;jenkins-hbase4:45535] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-12 08:16:56,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-12 08:16:56,442 INFO [M:0;jenkins-hbase4:45535] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-12 08:16:56,443 DEBUG [M:0;jenkins-hbase4:45535] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-12 08:16:56,443 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:56,443 DEBUG [M:0;jenkins-hbase4:45535] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:56,443 DEBUG [M:0;jenkins-hbase4:45535] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-12 08:16:56,443 DEBUG [M:0;jenkins-hbase4:45535] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:56,443 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.90 KB heapSize=452.09 KB 2023-07-12 08:16:56,470 INFO [M:0;jenkins-hbase4:45535] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.90 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a7c9be659bc847f89bc7d35df5cc417c 2023-07-12 08:16:56,475 INFO [M:0;jenkins-hbase4:45535] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7c9be659bc847f89bc7d35df5cc417c 2023-07-12 08:16:56,476 DEBUG [M:0;jenkins-hbase4:45535] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a7c9be659bc847f89bc7d35df5cc417c as hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a7c9be659bc847f89bc7d35df5cc417c 2023-07-12 08:16:56,480 INFO [M:0;jenkins-hbase4:45535] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a7c9be659bc847f89bc7d35df5cc417c 2023-07-12 08:16:56,480 INFO [M:0;jenkins-hbase4:45535] regionserver.HStore(1080): Added hdfs://localhost:41579/user/jenkins/test-data/a5117f01-569d-dd20-c03e-454a713f8e42/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a7c9be659bc847f89bc7d35df5cc417c, entries=119, sequenceid=899, filesize=28.7 K 2023-07-12 08:16:56,481 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegion(2948): Finished flush of dataSize ~375.90 KB/384921, heapSize ~452.08 KB/462928, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=899, compaction requested=false 2023-07-12 08:16:56,483 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-12 08:16:56,483 DEBUG [M:0;jenkins-hbase4:45535] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-12 08:16:56,491 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-12 08:16:56,491 INFO [M:0;jenkins-hbase4:45535] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-12 08:16:56,492 INFO [M:0;jenkins-hbase4:45535] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45535 2023-07-12 08:16:56,496 DEBUG [M:0;jenkins-hbase4:45535] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,45535,1689149645355 already deleted, retry=false 2023-07-12 08:16:56,535 INFO [RS:1;jenkins-hbase4:43379] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43379,1689149646981; zookeeper connection closed. 2023-07-12 08:16:56,535 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,536 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:43379-0x1015898a12d0002, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,536 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@22489e0] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@22489e0 2023-07-12 08:16:56,636 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,636 INFO [M:0;jenkins-hbase4:45535] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,45535,1689149645355; zookeeper connection closed. 2023-07-12 08:16:56,636 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): master:45535-0x1015898a12d0000, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,736 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,736 INFO [RS:0;jenkins-hbase4:40943] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40943,1689149646919; zookeeper connection closed. 2023-07-12 08:16:56,736 DEBUG [Listener at localhost/37289-EventThread] zookeeper.ZKWatcher(600): regionserver:40943-0x1015898a12d0001, quorum=127.0.0.1:55996, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-12 08:16:56,739 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a607a59] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a607a59 2023-07-12 08:16:56,739 INFO [Listener at jenkins-hbase4.apache.org/35773] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-12 08:16:56,739 WARN [Listener at jenkins-hbase4.apache.org/35773] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 08:16:56,764 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:56,765 WARN [1118932248@qtp-121838002-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46135] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-12 08:16:56,765 WARN [1118932248@qtp-121838002-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46135] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-12 08:16:56,869 WARN [BP-561408043-172.31.14.131-1689149640767 heartbeating to localhost/127.0.0.1:41579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 08:16:56,870 WARN [BP-561408043-172.31.14.131-1689149640767 heartbeating to localhost/127.0.0.1:41579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-561408043-172.31.14.131-1689149640767 (Datanode Uuid 745540a5-f4c3-4ecb-9b80-9c01ae152eae) service to localhost/127.0.0.1:41579 2023-07-12 08:16:56,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data5/current/BP-561408043-172.31.14.131-1689149640767] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:56,873 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data6/current/BP-561408043-172.31.14.131-1689149640767] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:56,875 WARN [Listener at jenkins-hbase4.apache.org/35773] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 08:16:56,879 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:56,983 WARN [BP-561408043-172.31.14.131-1689149640767 heartbeating to localhost/127.0.0.1:41579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 08:16:56,983 WARN [BP-561408043-172.31.14.131-1689149640767 heartbeating to localhost/127.0.0.1:41579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-561408043-172.31.14.131-1689149640767 (Datanode Uuid 9eb3704e-b89d-4163-be4d-bec4eafbc8f7) service to localhost/127.0.0.1:41579 2023-07-12 08:16:56,984 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data3/current/BP-561408043-172.31.14.131-1689149640767] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:56,984 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data4/current/BP-561408043-172.31.14.131-1689149640767] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:56,985 WARN [Listener at jenkins-hbase4.apache.org/35773] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-12 08:16:56,988 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:57,095 WARN [BP-561408043-172.31.14.131-1689149640767 heartbeating to localhost/127.0.0.1:41579] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-12 08:16:57,095 WARN [BP-561408043-172.31.14.131-1689149640767 heartbeating to localhost/127.0.0.1:41579] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-561408043-172.31.14.131-1689149640767 (Datanode Uuid d8add6fe-ce2e-4c07-9a33-241e7cda90ea) service to localhost/127.0.0.1:41579 2023-07-12 08:16:57,096 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data1/current/BP-561408043-172.31.14.131-1689149640767] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:57,097 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/49b79f48-173a-fa5a-f31b-784fddc71ca6/cluster_16008124-0861-a488-bc72-b4a5d86b70fe/dfs/data/data2/current/BP-561408043-172.31.14.131-1689149640767] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-12 08:16:57,122 INFO [Listener at jenkins-hbase4.apache.org/35773] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-12 08:16:57,256 INFO [Listener at jenkins-hbase4.apache.org/35773] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-12 08:16:57,359 INFO [Listener at jenkins-hbase4.apache.org/35773] hbase.HBaseTestingUtility(1293): Minicluster is down