2023-07-24 18:06:08,263 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 18:06:08,532 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab 2023-07-24 18:06:08,533 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 18:06:08,533 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 18:06:08,577 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 18:06:08,824 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 18:06:08,824 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135, deleteOnExit=true 2023-07-24 18:06:08,825 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 18:06:08,825 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/test.cache.data in system properties and HBase conf 2023-07-24 18:06:08,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 18:06:08,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop.log.dir in system properties and HBase conf 2023-07-24 18:06:08,827 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 18:06:08,828 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 18:06:08,828 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 18:06:09,144 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 18:06:09,150 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 18:06:09,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 18:06:09,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 18:06:09,151 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 18:06:09,152 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 18:06:09,152 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 18:06:09,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 18:06:09,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 18:06:09,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 18:06:09,154 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/nfs.dump.dir in system properties and HBase conf 2023-07-24 18:06:09,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir in system properties and HBase conf 2023-07-24 18:06:09,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 18:06:09,155 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 18:06:09,156 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 18:06:09,802 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 18:06:09,806 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 18:06:10,080 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 18:06:10,251 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 18:06:10,285 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:10,327 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:10,359 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_localhost_36131_hdfs____.757lfu/webapp 2023-07-24 18:06:10,514 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36131 2023-07-24 18:06:10,567 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 18:06:10,568 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 18:06:11,114 WARN [Listener at localhost/35665] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 18:06:11,197 WARN [Listener at localhost/35665] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 18:06:11,218 WARN [Listener at localhost/35665] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:11,227 INFO [Listener at localhost/35665] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:11,232 INFO [Listener at localhost/35665] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_localhost_39873_datanode____.tw0f8r/webapp 2023-07-24 18:06:11,347 INFO [Listener at localhost/35665] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39873 2023-07-24 18:06:11,856 WARN [Listener at localhost/33013] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 18:06:11,888 WARN [Listener at localhost/33013] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 18:06:11,893 WARN [Listener at localhost/33013] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:11,896 INFO [Listener at localhost/33013] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:11,904 INFO [Listener at localhost/33013] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_localhost_35235_datanode____k3bknt/webapp 2023-07-24 18:06:12,049 INFO [Listener at localhost/33013] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35235 2023-07-24 18:06:12,074 WARN [Listener at localhost/38407] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 18:06:12,153 WARN [Listener at localhost/38407] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 18:06:12,158 WARN [Listener at localhost/38407] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:12,160 INFO [Listener at localhost/38407] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:12,168 INFO [Listener at localhost/38407] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_localhost_34261_datanode____mv11lf/webapp 2023-07-24 18:06:12,314 INFO [Listener at localhost/38407] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34261 2023-07-24 18:06:12,350 WARN [Listener at localhost/42851] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 18:06:12,599 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed70b91ab093dc94: Processing first storage report for DS-15c887a2-70f7-47bd-a85c-d3204695417e from datanode 04b89a8d-76e4-475f-b19a-715666c2db2d 2023-07-24 18:06:12,601 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed70b91ab093dc94: from storage DS-15c887a2-70f7-47bd-a85c-d3204695417e node DatanodeRegistration(127.0.0.1:35345, datanodeUuid=04b89a8d-76e4-475f-b19a-715666c2db2d, infoPort=46257, infoSecurePort=0, ipcPort=38407, storageInfo=lv=-57;cid=testClusterID;nsid=1216709258;c=1690221969875), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 18:06:12,601 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5cb172826c54799f: Processing first storage report for DS-83745207-3550-4bc5-8f83-a97a90adb6f9 from datanode 78552ce0-280d-4e04-95c6-61ad13d13b69 2023-07-24 18:06:12,601 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5cb172826c54799f: from storage DS-83745207-3550-4bc5-8f83-a97a90adb6f9 node DatanodeRegistration(127.0.0.1:44585, datanodeUuid=78552ce0-280d-4e04-95c6-61ad13d13b69, infoPort=44827, infoSecurePort=0, ipcPort=42851, storageInfo=lv=-57;cid=testClusterID;nsid=1216709258;c=1690221969875), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 18:06:12,601 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x662cdc32635a0cf2: Processing first storage report for DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea from datanode 50a11137-d846-4cf0-a508-ad6fe2ab09cb 2023-07-24 18:06:12,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x662cdc32635a0cf2: from storage DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea node DatanodeRegistration(127.0.0.1:33993, datanodeUuid=50a11137-d846-4cf0-a508-ad6fe2ab09cb, infoPort=34205, infoSecurePort=0, ipcPort=33013, storageInfo=lv=-57;cid=testClusterID;nsid=1216709258;c=1690221969875), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 18:06:12,602 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed70b91ab093dc94: Processing first storage report for DS-913a4497-ea30-4f99-89c7-f2fc9b078e75 from datanode 04b89a8d-76e4-475f-b19a-715666c2db2d 2023-07-24 18:06:12,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed70b91ab093dc94: from storage DS-913a4497-ea30-4f99-89c7-f2fc9b078e75 node DatanodeRegistration(127.0.0.1:35345, datanodeUuid=04b89a8d-76e4-475f-b19a-715666c2db2d, infoPort=46257, infoSecurePort=0, ipcPort=38407, storageInfo=lv=-57;cid=testClusterID;nsid=1216709258;c=1690221969875), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 18:06:12,602 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5cb172826c54799f: Processing first storage report for DS-f22da949-4f4e-4966-80cb-e0aef4382a32 from datanode 78552ce0-280d-4e04-95c6-61ad13d13b69 2023-07-24 18:06:12,602 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5cb172826c54799f: from storage DS-f22da949-4f4e-4966-80cb-e0aef4382a32 node DatanodeRegistration(127.0.0.1:44585, datanodeUuid=78552ce0-280d-4e04-95c6-61ad13d13b69, infoPort=44827, infoSecurePort=0, ipcPort=42851, storageInfo=lv=-57;cid=testClusterID;nsid=1216709258;c=1690221969875), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 18:06:12,603 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x662cdc32635a0cf2: Processing first storage report for DS-24a41fde-f912-4996-8d1c-a8a62f833b79 from datanode 50a11137-d846-4cf0-a508-ad6fe2ab09cb 2023-07-24 18:06:12,603 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x662cdc32635a0cf2: from storage DS-24a41fde-f912-4996-8d1c-a8a62f833b79 node DatanodeRegistration(127.0.0.1:33993, datanodeUuid=50a11137-d846-4cf0-a508-ad6fe2ab09cb, infoPort=34205, infoSecurePort=0, ipcPort=33013, storageInfo=lv=-57;cid=testClusterID;nsid=1216709258;c=1690221969875), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 18:06:12,831 DEBUG [Listener at localhost/42851] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab 2023-07-24 18:06:12,928 INFO [Listener at localhost/42851] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/zookeeper_0, clientPort=57118, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 18:06:12,949 INFO [Listener at localhost/42851] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=57118 2023-07-24 18:06:12,961 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:12,964 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:13,652 INFO [Listener at localhost/42851] util.FSUtils(471): Created version file at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 with version=8 2023-07-24 18:06:13,652 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/hbase-staging 2023-07-24 18:06:14,021 INFO [Listener at localhost/42851] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 18:06:14,568 INFO [Listener at localhost/42851] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 18:06:14,640 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:14,641 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:14,641 INFO [Listener at localhost/42851] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 18:06:14,641 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:14,642 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 18:06:14,827 INFO [Listener at localhost/42851] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 18:06:14,924 DEBUG [Listener at localhost/42851] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 18:06:15,031 INFO [Listener at localhost/42851] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42435 2023-07-24 18:06:15,051 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,053 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,085 INFO [Listener at localhost/42851] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42435 connecting to ZooKeeper ensemble=127.0.0.1:57118 2023-07-24 18:06:15,140 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:424350x0, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 18:06:15,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42435-0x101988310a50000 connected 2023-07-24 18:06:15,182 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 18:06:15,183 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:06:15,197 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 18:06:15,210 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42435 2023-07-24 18:06:15,210 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42435 2023-07-24 18:06:15,211 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42435 2023-07-24 18:06:15,214 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42435 2023-07-24 18:06:15,215 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42435 2023-07-24 18:06:15,223 INFO [Listener at localhost/42851] master.HMaster(444): hbase.rootdir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, hbase.cluster.distributed=false 2023-07-24 18:06:15,292 INFO [Listener at localhost/42851] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 18:06:15,293 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,293 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,293 INFO [Listener at localhost/42851] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 18:06:15,293 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,293 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 18:06:15,298 INFO [Listener at localhost/42851] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 18:06:15,302 INFO [Listener at localhost/42851] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34839 2023-07-24 18:06:15,305 INFO [Listener at localhost/42851] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 18:06:15,312 INFO [Listener at localhost/42851] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 18:06:15,313 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,315 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,317 INFO [Listener at localhost/42851] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34839 connecting to ZooKeeper ensemble=127.0.0.1:57118 2023-07-24 18:06:15,321 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:348390x0, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 18:06:15,323 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:348390x0, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 18:06:15,325 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34839-0x101988310a50001 connected 2023-07-24 18:06:15,325 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:06:15,326 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 18:06:15,330 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34839 2023-07-24 18:06:15,334 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34839 2023-07-24 18:06:15,335 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34839 2023-07-24 18:06:15,338 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34839 2023-07-24 18:06:15,339 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34839 2023-07-24 18:06:15,353 INFO [Listener at localhost/42851] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 18:06:15,354 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,354 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,354 INFO [Listener at localhost/42851] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 18:06:15,355 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,355 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 18:06:15,355 INFO [Listener at localhost/42851] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 18:06:15,357 INFO [Listener at localhost/42851] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37319 2023-07-24 18:06:15,357 INFO [Listener at localhost/42851] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 18:06:15,358 INFO [Listener at localhost/42851] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 18:06:15,359 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,362 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,364 INFO [Listener at localhost/42851] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37319 connecting to ZooKeeper ensemble=127.0.0.1:57118 2023-07-24 18:06:15,373 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:373190x0, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 18:06:15,374 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:373190x0, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 18:06:15,375 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37319-0x101988310a50002 connected 2023-07-24 18:06:15,375 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:06:15,376 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 18:06:15,377 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37319 2023-07-24 18:06:15,378 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37319 2023-07-24 18:06:15,381 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37319 2023-07-24 18:06:15,382 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37319 2023-07-24 18:06:15,384 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37319 2023-07-24 18:06:15,402 INFO [Listener at localhost/42851] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 18:06:15,402 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,403 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,403 INFO [Listener at localhost/42851] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 18:06:15,403 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 18:06:15,403 INFO [Listener at localhost/42851] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 18:06:15,403 INFO [Listener at localhost/42851] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 18:06:15,405 INFO [Listener at localhost/42851] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42037 2023-07-24 18:06:15,406 INFO [Listener at localhost/42851] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 18:06:15,411 INFO [Listener at localhost/42851] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 18:06:15,412 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,414 INFO [Listener at localhost/42851] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,416 INFO [Listener at localhost/42851] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42037 connecting to ZooKeeper ensemble=127.0.0.1:57118 2023-07-24 18:06:15,422 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:420370x0, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 18:06:15,423 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:420370x0, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 18:06:15,424 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42037-0x101988310a50003 connected 2023-07-24 18:06:15,424 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:06:15,425 DEBUG [Listener at localhost/42851] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 18:06:15,430 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42037 2023-07-24 18:06:15,431 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42037 2023-07-24 18:06:15,438 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42037 2023-07-24 18:06:15,439 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42037 2023-07-24 18:06:15,440 DEBUG [Listener at localhost/42851] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42037 2023-07-24 18:06:15,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:15,455 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 18:06:15,456 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:15,483 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 18:06:15,483 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 18:06:15,483 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 18:06:15,484 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 18:06:15,485 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:15,489 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 18:06:15,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 18:06:15,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42435,1690221973837 from backup master directory 2023-07-24 18:06:15,494 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:15,494 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 18:06:15,495 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 18:06:15,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:15,500 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 18:06:15,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 18:06:15,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/hbase.id with ID: 87acecc9-f72a-4f12-8121-7a52b3e27a21 2023-07-24 18:06:15,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 18:06:15,721 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:15,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x68a64892 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:15,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18144d19, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:15,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 18:06:15,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 18:06:15,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 18:06:15,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 18:06:15,910 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 18:06:15,914 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 18:06:15,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 18:06:15,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store-tmp 2023-07-24 18:06:16,008 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:16,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 18:06:16,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:06:16,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:06:16,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 18:06:16,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:06:16,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:06:16,009 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 18:06:16,011 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/WALs/jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:16,034 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42435%2C1690221973837, suffix=, logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/WALs/jenkins-hbase4.apache.org,42435,1690221973837, archiveDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/oldWALs, maxLogs=10 2023-07-24 18:06:16,112 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK] 2023-07-24 18:06:16,112 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK] 2023-07-24 18:06:16,112 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK] 2023-07-24 18:06:16,121 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 18:06:16,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/WALs/jenkins-hbase4.apache.org,42435,1690221973837/jenkins-hbase4.apache.org%2C42435%2C1690221973837.1690221976045 2023-07-24 18:06:16,223 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK], DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK]] 2023-07-24 18:06:16,224 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 18:06:16,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:16,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 18:06:16,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 18:06:16,324 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 18:06:16,334 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 18:06:16,375 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 18:06:16,391 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:16,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 18:06:16,401 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 18:06:16,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 18:06:16,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:16,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69782391, jitterRate=0.03983865678310394}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:16,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 18:06:16,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 18:06:16,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 18:06:16,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 18:06:16,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 18:06:16,474 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 18:06:16,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 54 msec 2023-07-24 18:06:16,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 18:06:16,573 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 18:06:16,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 18:06:16,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 18:06:16,623 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 18:06:16,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 18:06:16,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 18:06:16,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 18:06:16,646 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:16,648 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 18:06:16,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 18:06:16,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 18:06:16,669 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 18:06:16,669 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 18:06:16,669 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 18:06:16,669 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 18:06:16,670 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:16,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42435,1690221973837, sessionid=0x101988310a50000, setting cluster-up flag (Was=false) 2023-07-24 18:06:16,690 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:16,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 18:06:16,701 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:16,710 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:16,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 18:06:16,727 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:16,731 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp 2023-07-24 18:06:16,746 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(951): ClusterId : 87acecc9-f72a-4f12-8121-7a52b3e27a21 2023-07-24 18:06:16,765 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(951): ClusterId : 87acecc9-f72a-4f12-8121-7a52b3e27a21 2023-07-24 18:06:16,763 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(951): ClusterId : 87acecc9-f72a-4f12-8121-7a52b3e27a21 2023-07-24 18:06:16,780 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 18:06:16,786 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 18:06:16,791 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 18:06:16,791 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 18:06:16,786 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 18:06:16,791 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 18:06:16,793 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 18:06:16,796 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 18:06:16,796 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 18:06:16,796 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 18:06:16,798 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ReadOnlyZKClient(139): Connect 0x79f1a985 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:16,799 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 18:06:16,800 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 18:06:16,812 DEBUG [RS:2;jenkins-hbase4:42037] zookeeper.ReadOnlyZKClient(139): Connect 0x61706be8 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:16,812 DEBUG [RS:1;jenkins-hbase4:37319] zookeeper.ReadOnlyZKClient(139): Connect 0x3977459d to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:16,832 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@33d42fdf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:16,837 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51a4e882, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 18:06:16,840 DEBUG [RS:2;jenkins-hbase4:42037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb789b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:16,841 DEBUG [RS:2;jenkins-hbase4:42037] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b880098, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 18:06:16,848 DEBUG [RS:1;jenkins-hbase4:37319] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@bc4d2b6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:16,849 DEBUG [RS:1;jenkins-hbase4:37319] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41ede2a1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 18:06:16,869 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37319 2023-07-24 18:06:16,871 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:34839 2023-07-24 18:06:16,878 INFO [RS:1;jenkins-hbase4:37319] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 18:06:16,879 INFO [RS:1;jenkins-hbase4:37319] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 18:06:16,878 INFO [RS:0;jenkins-hbase4:34839] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 18:06:16,880 INFO [RS:0;jenkins-hbase4:34839] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 18:06:16,901 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42037 2023-07-24 18:06:16,901 INFO [RS:2;jenkins-hbase4:42037] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 18:06:16,901 INFO [RS:2;jenkins-hbase4:42037] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 18:06:16,902 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 18:06:16,902 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 18:06:16,902 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 18:06:16,902 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 18:06:16,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:16,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 18:06:16,906 INFO [RS:1;jenkins-hbase4:37319] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:16,906 INFO [RS:0;jenkins-hbase4:34839] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:16,907 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 18:06:16,906 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 18:06:16,906 INFO [RS:2;jenkins-hbase4:42037] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:16,907 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 18:06:16,910 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42435,1690221973837 with isa=jenkins-hbase4.apache.org/172.31.14.131:42037, startcode=1690221975401 2023-07-24 18:06:16,910 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42435,1690221973837 with isa=jenkins-hbase4.apache.org/172.31.14.131:34839, startcode=1690221975292 2023-07-24 18:06:16,910 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42435,1690221973837 with isa=jenkins-hbase4.apache.org/172.31.14.131:37319, startcode=1690221975353 2023-07-24 18:06:16,932 DEBUG [RS:0;jenkins-hbase4:34839] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 18:06:16,932 DEBUG [RS:1;jenkins-hbase4:37319] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 18:06:16,932 DEBUG [RS:2;jenkins-hbase4:42037] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 18:06:17,012 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34075, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 18:06:17,012 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45097, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 18:06:17,012 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44825, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 18:06:17,027 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42435] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 18:06:17,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 18:06:17,038 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42435] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 18:06:17,040 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42435] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 18:06:17,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 18:06:17,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 18:06:17,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 18:06:17,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 18:06:17,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 18:06:17,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 18:06:17,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,057 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690222007057 2023-07-24 18:06:17,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 18:06:17,064 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 18:06:17,065 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 18:06:17,069 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 18:06:17,069 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 18:06:17,069 WARN [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 18:06:17,069 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 18:06:17,069 WARN [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 18:06:17,070 WARN [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 18:06:17,071 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 18:06:17,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 18:06:17,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 18:06:17,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 18:06:17,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 18:06:17,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 18:06:17,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 18:06:17,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 18:06:17,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 18:06:17,096 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 18:06:17,097 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 18:06:17,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690221977098,5,FailOnTimeoutGroup] 2023-07-24 18:06:17,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690221977099,5,FailOnTimeoutGroup] 2023-07-24 18:06:17,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 18:06:17,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,142 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 18:06:17,144 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 18:06:17,145 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:17,172 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42435,1690221973837 with isa=jenkins-hbase4.apache.org/172.31.14.131:42037, startcode=1690221975401 2023-07-24 18:06:17,172 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42435,1690221973837 with isa=jenkins-hbase4.apache.org/172.31.14.131:37319, startcode=1690221975353 2023-07-24 18:06:17,172 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42435,1690221973837 with isa=jenkins-hbase4.apache.org/172.31.14.131:34839, startcode=1690221975292 2023-07-24 18:06:17,183 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42435] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,190 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42435] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,194 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:17,194 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35665 2023-07-24 18:06:17,194 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42435] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,195 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 18:06:17,197 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:17,197 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35665 2023-07-24 18:06:17,197 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 18:06:17,201 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:17,201 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35665 2023-07-24 18:06:17,201 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 18:06:17,206 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 18:06:17,208 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,208 DEBUG [RS:1;jenkins-hbase4:37319] zookeeper.ZKUtil(162): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,208 WARN [RS:0;jenkins-hbase4:34839] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 18:06:17,208 WARN [RS:1;jenkins-hbase4:37319] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 18:06:17,213 INFO [RS:0;jenkins-hbase4:34839] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 18:06:17,213 DEBUG [RS:2;jenkins-hbase4:42037] zookeeper.ZKUtil(162): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,214 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,214 WARN [RS:2;jenkins-hbase4:42037] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 18:06:17,213 INFO [RS:1;jenkins-hbase4:37319] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 18:06:17,219 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,214 INFO [RS:2;jenkins-hbase4:42037] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 18:06:17,220 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,220 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42037,1690221975401] 2023-07-24 18:06:17,220 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34839,1690221975292] 2023-07-24 18:06:17,220 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37319,1690221975353] 2023-07-24 18:06:17,232 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:17,235 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,235 DEBUG [RS:2;jenkins-hbase4:42037] zookeeper.ZKUtil(162): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,235 DEBUG [RS:1;jenkins-hbase4:37319] zookeeper.ZKUtil(162): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 18:06:17,236 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,236 DEBUG [RS:2;jenkins-hbase4:42037] zookeeper.ZKUtil(162): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,236 DEBUG [RS:1;jenkins-hbase4:37319] zookeeper.ZKUtil(162): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,237 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ZKUtil(162): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,237 DEBUG [RS:2;jenkins-hbase4:42037] zookeeper.ZKUtil(162): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,237 DEBUG [RS:1;jenkins-hbase4:37319] zookeeper.ZKUtil(162): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,240 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/info 2023-07-24 18:06:17,241 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 18:06:17,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:17,242 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 18:06:17,246 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/rep_barrier 2023-07-24 18:06:17,246 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 18:06:17,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:17,248 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 18:06:17,251 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/table 2023-07-24 18:06:17,251 DEBUG [RS:1;jenkins-hbase4:37319] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 18:06:17,251 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 18:06:17,252 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 18:06:17,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:17,255 DEBUG [RS:0;jenkins-hbase4:34839] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 18:06:17,256 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740 2023-07-24 18:06:17,257 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740 2023-07-24 18:06:17,264 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 18:06:17,267 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 18:06:17,267 INFO [RS:2;jenkins-hbase4:42037] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 18:06:17,268 INFO [RS:0;jenkins-hbase4:34839] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 18:06:17,269 INFO [RS:1;jenkins-hbase4:37319] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 18:06:17,302 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:17,304 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66083070, jitterRate=-0.015285521745681763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 18:06:17,304 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 18:06:17,304 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 18:06:17,304 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 18:06:17,304 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 18:06:17,304 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 18:06:17,304 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 18:06:17,305 INFO [RS:0;jenkins-hbase4:34839] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 18:06:17,305 INFO [RS:2;jenkins-hbase4:42037] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 18:06:17,305 INFO [RS:1;jenkins-hbase4:37319] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 18:06:17,331 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 18:06:17,331 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 18:06:17,334 INFO [RS:1;jenkins-hbase4:37319] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 18:06:17,334 INFO [RS:0;jenkins-hbase4:34839] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 18:06:17,335 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,337 INFO [RS:2;jenkins-hbase4:42037] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 18:06:17,339 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,340 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,340 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 18:06:17,341 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 18:06:17,347 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 18:06:17,349 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 18:06:17,349 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 18:06:17,360 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,360 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,361 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,361 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,361 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,361 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,360 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,363 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,363 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 18:06:17,363 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,363 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,362 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 18:06:17,364 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,364 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,364 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 18:06:17,364 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 18:06:17,364 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,364 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:2;jenkins-hbase4:42037] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,364 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:1;jenkins-hbase4:37319] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,365 DEBUG [RS:0;jenkins-hbase4:34839] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 18:06:17,387 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,387 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,387 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,391 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,391 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 18:06:17,392 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,392 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,398 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,398 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,398 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,414 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 18:06:17,423 INFO [RS:0;jenkins-hbase4:34839] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 18:06:17,427 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34839,1690221975292-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,426 INFO [RS:1;jenkins-hbase4:37319] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 18:06:17,433 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37319,1690221975353-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,440 INFO [RS:2;jenkins-hbase4:42037] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 18:06:17,440 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42037,1690221975401-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:17,479 INFO [RS:1;jenkins-hbase4:37319] regionserver.Replication(203): jenkins-hbase4.apache.org,37319,1690221975353 started 2023-07-24 18:06:17,479 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37319,1690221975353, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37319, sessionid=0x101988310a50002 2023-07-24 18:06:17,480 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 18:06:17,480 DEBUG [RS:1;jenkins-hbase4:37319] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,480 DEBUG [RS:1;jenkins-hbase4:37319] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37319,1690221975353' 2023-07-24 18:06:17,480 DEBUG [RS:1;jenkins-hbase4:37319] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 18:06:17,489 DEBUG [RS:1;jenkins-hbase4:37319] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 18:06:17,490 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 18:06:17,490 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 18:06:17,492 DEBUG [RS:1;jenkins-hbase4:37319] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:17,501 INFO [RS:2;jenkins-hbase4:42037] regionserver.Replication(203): jenkins-hbase4.apache.org,42037,1690221975401 started 2023-07-24 18:06:17,493 INFO [RS:0;jenkins-hbase4:34839] regionserver.Replication(203): jenkins-hbase4.apache.org,34839,1690221975292 started 2023-07-24 18:06:17,502 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42037,1690221975401, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42037, sessionid=0x101988310a50003 2023-07-24 18:06:17,502 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 18:06:17,502 DEBUG [RS:1;jenkins-hbase4:37319] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37319,1690221975353' 2023-07-24 18:06:17,504 DEBUG [RS:1;jenkins-hbase4:37319] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:17,502 DEBUG [RS:2;jenkins-hbase4:42037] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,505 DEBUG [RS:2;jenkins-hbase4:42037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42037,1690221975401' 2023-07-24 18:06:17,505 DEBUG [RS:2;jenkins-hbase4:42037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 18:06:17,506 DEBUG [RS:2;jenkins-hbase4:42037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 18:06:17,509 DEBUG [RS:1;jenkins-hbase4:37319] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:17,509 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 18:06:17,509 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 18:06:17,502 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34839,1690221975292, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34839, sessionid=0x101988310a50001 2023-07-24 18:06:17,510 DEBUG [RS:1;jenkins-hbase4:37319] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 18:06:17,510 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 18:06:17,510 INFO [RS:1;jenkins-hbase4:37319] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 18:06:17,510 INFO [RS:1;jenkins-hbase4:37319] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 18:06:17,509 DEBUG [RS:2;jenkins-hbase4:42037] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,511 DEBUG [RS:2;jenkins-hbase4:42037] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42037,1690221975401' 2023-07-24 18:06:17,511 DEBUG [RS:2;jenkins-hbase4:42037] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:17,510 DEBUG [RS:0;jenkins-hbase4:34839] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,511 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34839,1690221975292' 2023-07-24 18:06:17,511 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 18:06:17,512 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 18:06:17,515 DEBUG [RS:2;jenkins-hbase4:42037] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:17,515 DEBUG [RS:2;jenkins-hbase4:42037] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 18:06:17,515 INFO [RS:2;jenkins-hbase4:42037] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 18:06:17,516 INFO [RS:2;jenkins-hbase4:42037] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 18:06:17,518 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 18:06:17,518 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 18:06:17,518 DEBUG [RS:0;jenkins-hbase4:34839] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:17,518 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34839,1690221975292' 2023-07-24 18:06:17,518 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:17,519 DEBUG [RS:0;jenkins-hbase4:34839] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:17,519 DEBUG [RS:0;jenkins-hbase4:34839] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 18:06:17,519 INFO [RS:0;jenkins-hbase4:34839] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 18:06:17,519 INFO [RS:0;jenkins-hbase4:34839] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 18:06:17,567 DEBUG [jenkins-hbase4:42435] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 18:06:17,573 DEBUG [jenkins-hbase4:42435] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:06:17,579 DEBUG [jenkins-hbase4:42435] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:06:17,579 DEBUG [jenkins-hbase4:42435] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:06:17,579 DEBUG [jenkins-hbase4:42435] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:06:17,579 DEBUG [jenkins-hbase4:42435] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:06:17,583 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42037,1690221975401, state=OPENING 2023-07-24 18:06:17,590 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 18:06:17,591 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:17,592 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 18:06:17,595 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:17,623 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34839%2C1690221975292, suffix=, logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,34839,1690221975292, archiveDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs, maxLogs=32 2023-07-24 18:06:17,624 INFO [RS:1;jenkins-hbase4:37319] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37319%2C1690221975353, suffix=, logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,37319,1690221975353, archiveDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs, maxLogs=32 2023-07-24 18:06:17,627 INFO [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42037%2C1690221975401, suffix=, logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,42037,1690221975401, archiveDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs, maxLogs=32 2023-07-24 18:06:17,663 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK] 2023-07-24 18:06:17,663 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK] 2023-07-24 18:06:17,664 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK] 2023-07-24 18:06:17,700 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK] 2023-07-24 18:06:17,700 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK] 2023-07-24 18:06:17,700 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK] 2023-07-24 18:06:17,729 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK] 2023-07-24 18:06:17,729 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK] 2023-07-24 18:06:17,729 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK] 2023-07-24 18:06:17,744 INFO [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,42037,1690221975401/jenkins-hbase4.apache.org%2C42037%2C1690221975401.1690221977629 2023-07-24 18:06:17,744 DEBUG [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK], DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK]] 2023-07-24 18:06:17,744 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,34839,1690221975292/jenkins-hbase4.apache.org%2C34839%2C1690221975292.1690221977628 2023-07-24 18:06:17,745 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK], DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK]] 2023-07-24 18:06:17,755 INFO [RS:1;jenkins-hbase4:37319] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,37319,1690221975353/jenkins-hbase4.apache.org%2C37319%2C1690221975353.1690221977629 2023-07-24 18:06:17,759 DEBUG [RS:1;jenkins-hbase4:37319] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK], DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK], DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK]] 2023-07-24 18:06:17,806 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:17,809 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 18:06:17,817 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 18:06:17,846 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 18:06:17,847 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 18:06:17,850 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42037%2C1690221975401.meta, suffix=.meta, logDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,42037,1690221975401, archiveDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs, maxLogs=32 2023-07-24 18:06:17,878 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK] 2023-07-24 18:06:17,879 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK] 2023-07-24 18:06:17,879 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK] 2023-07-24 18:06:17,887 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/WALs/jenkins-hbase4.apache.org,42037,1690221975401/jenkins-hbase4.apache.org%2C42037%2C1690221975401.meta.1690221977851.meta 2023-07-24 18:06:17,887 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44585,DS-83745207-3550-4bc5-8f83-a97a90adb6f9,DISK], DatanodeInfoWithStorage[127.0.0.1:33993,DS-bed8d877-8e72-4c6c-8cfb-81f3d3fac3ea,DISK], DatanodeInfoWithStorage[127.0.0.1:35345,DS-15c887a2-70f7-47bd-a85c-d3204695417e,DISK]] 2023-07-24 18:06:17,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 18:06:17,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 18:06:17,890 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:17,891 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 18:06:17,893 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 18:06:17,895 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 18:06:17,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 18:06:17,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:17,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 18:06:17,908 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 18:06:17,911 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 18:06:17,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/info 2023-07-24 18:06:17,913 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/info 2023-07-24 18:06:17,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 18:06:17,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:17,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 18:06:17,916 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/rep_barrier 2023-07-24 18:06:17,916 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/rep_barrier 2023-07-24 18:06:17,916 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 18:06:17,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:17,917 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 18:06:17,919 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/table 2023-07-24 18:06:17,919 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/table 2023-07-24 18:06:17,919 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 18:06:17,920 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:17,922 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740 2023-07-24 18:06:17,924 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740 2023-07-24 18:06:17,929 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 18:06:17,931 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 18:06:17,933 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72790656, jitterRate=0.08466529846191406}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 18:06:17,935 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 18:06:17,945 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690221977794 2023-07-24 18:06:17,963 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 18:06:17,964 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 18:06:17,965 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,42037,1690221975401, state=OPEN 2023-07-24 18:06:17,968 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 18:06:17,968 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 18:06:17,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 18:06:17,973 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,42037,1690221975401 in 373 msec 2023-07-24 18:06:17,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 18:06:17,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 612 msec 2023-07-24 18:06:17,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0670 sec 2023-07-24 18:06:17,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690221977983, completionTime=-1 2023-07-24 18:06:17,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 18:06:17,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 18:06:18,073 DEBUG [hconnection-0x265a1ba0-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:18,077 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:18,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 18:06:18,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690222038115 2023-07-24 18:06:18,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690222098115 2023-07-24 18:06:18,115 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 131 msec 2023-07-24 18:06:18,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42435,1690221973837-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:18,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42435,1690221973837-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:18,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42435,1690221973837-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:18,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42435, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:18,167 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 18:06:18,176 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 18:06:18,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 18:06:18,189 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 18:06:18,202 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 18:06:18,206 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:06:18,209 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:06:18,234 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,237 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b empty. 2023-07-24 18:06:18,238 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 18:06:18,301 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 18:06:18,305 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 66da5a695a64d1bbf76e8ecddb18ae4b, NAME => 'hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:06:18,331 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:18,331 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 66da5a695a64d1bbf76e8ecddb18ae4b, disabling compactions & flushes 2023-07-24 18:06:18,331 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,331 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,331 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. after waiting 0 ms 2023-07-24 18:06:18,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,332 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,332 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 66da5a695a64d1bbf76e8ecddb18ae4b: 2023-07-24 18:06:18,339 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:06:18,356 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690221978342"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690221978342"}]},"ts":"1690221978342"} 2023-07-24 18:06:18,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 18:06:18,395 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:06:18,400 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690221978395"}]},"ts":"1690221978395"} 2023-07-24 18:06:18,406 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 18:06:18,415 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:06:18,416 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:06:18,416 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:06:18,416 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:06:18,416 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:06:18,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=66da5a695a64d1bbf76e8ecddb18ae4b, ASSIGN}] 2023-07-24 18:06:18,423 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=66da5a695a64d1bbf76e8ecddb18ae4b, ASSIGN 2023-07-24 18:06:18,426 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=66da5a695a64d1bbf76e8ecddb18ae4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:06:18,578 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 18:06:18,580 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=66da5a695a64d1bbf76e8ecddb18ae4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:18,580 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690221978579"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690221978579"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690221978579"}]},"ts":"1690221978579"} 2023-07-24 18:06:18,585 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 66da5a695a64d1bbf76e8ecddb18ae4b, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:18,748 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 66da5a695a64d1bbf76e8ecddb18ae4b, NAME => 'hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.', STARTKEY => '', ENDKEY => ''} 2023-07-24 18:06:18,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. service=AccessControlService 2023-07-24 18:06:18,749 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:18,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:18,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,750 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,752 INFO [StoreOpener-66da5a695a64d1bbf76e8ecddb18ae4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,754 DEBUG [StoreOpener-66da5a695a64d1bbf76e8ecddb18ae4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/info 2023-07-24 18:06:18,754 DEBUG [StoreOpener-66da5a695a64d1bbf76e8ecddb18ae4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/info 2023-07-24 18:06:18,755 INFO [StoreOpener-66da5a695a64d1bbf76e8ecddb18ae4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 66da5a695a64d1bbf76e8ecddb18ae4b columnFamilyName info 2023-07-24 18:06:18,756 INFO [StoreOpener-66da5a695a64d1bbf76e8ecddb18ae4b-1] regionserver.HStore(310): Store=66da5a695a64d1bbf76e8ecddb18ae4b/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:18,758 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,760 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:06:18,768 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:18,769 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 66da5a695a64d1bbf76e8ecddb18ae4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75235817, jitterRate=0.12110103666782379}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:18,769 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 66da5a695a64d1bbf76e8ecddb18ae4b: 2023-07-24 18:06:18,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b., pid=6, masterSystemTime=1690221978741 2023-07-24 18:06:18,774 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,774 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:06:18,776 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=66da5a695a64d1bbf76e8ecddb18ae4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:18,776 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690221978775"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690221978775"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690221978775"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690221978775"}]},"ts":"1690221978775"} 2023-07-24 18:06:18,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 18:06:18,784 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 66da5a695a64d1bbf76e8ecddb18ae4b, server=jenkins-hbase4.apache.org,42037,1690221975401 in 195 msec 2023-07-24 18:06:18,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 18:06:18,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=66da5a695a64d1bbf76e8ecddb18ae4b, ASSIGN in 365 msec 2023-07-24 18:06:18,790 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:06:18,790 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690221978790"}]},"ts":"1690221978790"} 2023-07-24 18:06:18,792 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 18:06:18,795 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:06:18,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 605 msec 2023-07-24 18:06:18,805 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 18:06:18,806 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 18:06:18,806 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:18,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 18:06:18,856 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 18:06:18,863 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2023-07-24 18:06:18,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 18:06:18,879 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 18:06:18,884 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2023-07-24 18:06:18,895 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 18:06:18,897 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 18:06:18,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.402sec 2023-07-24 18:06:18,901 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 18:06:18,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 18:06:18,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 18:06:18,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42435,1690221973837-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 18:06:18,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42435,1690221973837-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 18:06:18,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 18:06:18,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 18:06:18,930 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:06:18,932 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:06:18,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 18:06:18,935 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:18,936 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9 empty. 2023-07-24 18:06:18,939 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:18,939 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 18:06:18,944 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 18:06:18,968 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 18:06:18,971 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 91c2d61de8df837bf185c431ca87d6a9, NAME => 'hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:06:18,979 DEBUG [Listener at localhost/42851] zookeeper.ReadOnlyZKClient(139): Connect 0x572c911d to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:19,011 DEBUG [Listener at localhost/42851] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7dd24843, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:19,036 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:19,037 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 91c2d61de8df837bf185c431ca87d6a9, disabling compactions & flushes 2023-07-24 18:06:19,037 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,037 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,037 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. after waiting 0 ms 2023-07-24 18:06:19,037 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,037 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,037 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 91c2d61de8df837bf185c431ca87d6a9: 2023-07-24 18:06:19,045 DEBUG [hconnection-0x78b47ac1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:19,050 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:06:19,050 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 18:06:19,052 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690221979052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690221979052"}]},"ts":"1690221979052"} 2023-07-24 18:06:19,057 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 18:06:19,059 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:06:19,060 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690221979059"}]},"ts":"1690221979059"} 2023-07-24 18:06:19,065 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 18:06:19,066 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50778, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:19,070 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:06:19,070 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 18:06:19,071 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/test.cache.data in system properties and HBase conf 2023-07-24 18:06:19,073 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 18:06:19,073 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop.log.dir in system properties and HBase conf 2023-07-24 18:06:19,073 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 18:06:19,074 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 18:06:19,074 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 18:06:19,074 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 18:06:19,074 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 18:06:19,074 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 18:06:19,074 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:06:19,074 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/nfs.dump.dir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir in system properties and HBase conf 2023-07-24 18:06:19,075 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 18:06:19,076 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 18:06:19,076 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:06:19,076 INFO [Listener at localhost/42851] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 18:06:19,076 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:06:19,076 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:06:19,076 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:06:19,076 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=91c2d61de8df837bf185c431ca87d6a9, ASSIGN}] 2023-07-24 18:06:19,081 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=91c2d61de8df837bf185c431ca87d6a9, ASSIGN 2023-07-24 18:06:19,083 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=91c2d61de8df837bf185c431ca87d6a9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:06:19,233 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 18:06:19,234 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=91c2d61de8df837bf185c431ca87d6a9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:19,235 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690221979234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690221979234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690221979234"}]},"ts":"1690221979234"} 2023-07-24 18:06:19,239 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 91c2d61de8df837bf185c431ca87d6a9, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:19,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 18:06:19,399 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 91c2d61de8df837bf185c431ca87d6a9, NAME => 'hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.', STARTKEY => '', ENDKEY => ''} 2023-07-24 18:06:19,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. service=AccessControlService 2023-07-24 18:06:19,400 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:19,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:19,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,403 INFO [StoreOpener-91c2d61de8df837bf185c431ca87d6a9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,405 DEBUG [StoreOpener-91c2d61de8df837bf185c431ca87d6a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/l 2023-07-24 18:06:19,405 DEBUG [StoreOpener-91c2d61de8df837bf185c431ca87d6a9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/l 2023-07-24 18:06:19,406 INFO [StoreOpener-91c2d61de8df837bf185c431ca87d6a9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 91c2d61de8df837bf185c431ca87d6a9 columnFamilyName l 2023-07-24 18:06:19,407 INFO [StoreOpener-91c2d61de8df837bf185c431ca87d6a9-1] regionserver.HStore(310): Store=91c2d61de8df837bf185c431ca87d6a9/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:19,408 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,410 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,415 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:06:19,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:19,422 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 91c2d61de8df837bf185c431ca87d6a9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73805923, jitterRate=0.09979395568370819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:19,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 91c2d61de8df837bf185c431ca87d6a9: 2023-07-24 18:06:19,424 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9., pid=11, masterSystemTime=1690221979394 2023-07-24 18:06:19,427 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,427 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:06:19,428 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=91c2d61de8df837bf185c431ca87d6a9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:19,428 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690221979428"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690221979428"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690221979428"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690221979428"}]},"ts":"1690221979428"} 2023-07-24 18:06:19,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 18:06:19,442 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 91c2d61de8df837bf185c431ca87d6a9, server=jenkins-hbase4.apache.org,42037,1690221975401 in 194 msec 2023-07-24 18:06:19,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 18:06:19,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=91c2d61de8df837bf185c431ca87d6a9, ASSIGN in 366 msec 2023-07-24 18:06:19,451 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:06:19,451 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690221979451"}]},"ts":"1690221979451"} 2023-07-24 18:06:19,454 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 18:06:19,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:06:19,461 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 532 msec 2023-07-24 18:06:19,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 18:06:19,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 18:06:19,560 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 18:06:20,452 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:20,771 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:20,777 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37537_jobhistory____.1kqhu/webapp 2023-07-24 18:06:20,959 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 18:06:20,959 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 18:06:20,959 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 18:06:20,961 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 18:06:21,034 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:21,315 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:21,613 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 18:06:21,661 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37537 2023-07-24 18:06:21,941 WARN [Listener at jenkins-hbase4.apache.org/42719] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:22,320 WARN [Listener at jenkins-hbase4.apache.org/42719] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 18:06:22,321 INFO [Listener at jenkins-hbase4.apache.org/42719] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:22,337 INFO [Listener at jenkins-hbase4.apache.org/42719] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37477_cluster____qbavzo/webapp 2023-07-24 18:06:22,421 INFO [Listener at jenkins-hbase4.apache.org/42719] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 18:06:22,421 INFO [Listener at jenkins-hbase4.apache.org/42719] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 18:06:22,421 INFO [Listener at jenkins-hbase4.apache.org/42719] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 18:06:22,422 INFO [Listener at jenkins-hbase4.apache.org/42719] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 18:06:22,431 INFO [Listener at jenkins-hbase4.apache.org/42719] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:22,771 INFO [Listener at jenkins-hbase4.apache.org/42719] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:22,966 INFO [Listener at jenkins-hbase4.apache.org/42719] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:23,053 INFO [Listener at jenkins-hbase4.apache.org/42719] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37477 2023-07-24 18:06:23,594 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:06:23,756 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 18:06:23,758 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 18:06:23,762 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 18:06:24,017 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:24,017 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 18:06:24,018 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:24,018 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 18:06:24,018 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 18:06:24,018 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 18:06:24,018 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:24,018 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 18:06:24,018 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 18:06:24,018 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 18:06:24,134 WARN [Listener at jenkins-hbase4.apache.org/35341] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:24,160 WARN [Listener at jenkins-hbase4.apache.org/35341] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 18:06:24,160 INFO [Listener at jenkins-hbase4.apache.org/35341] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:24,168 INFO [Listener at jenkins-hbase4.apache.org/35341] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34083_node____flcpd4/webapp 2023-07-24 18:06:24,242 INFO [Listener at jenkins-hbase4.apache.org/35341] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 18:06:24,242 INFO [Listener at jenkins-hbase4.apache.org/35341] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 18:06:24,243 INFO [Listener at jenkins-hbase4.apache.org/35341] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 18:06:24,243 INFO [Listener at jenkins-hbase4.apache.org/35341] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 18:06:24,253 INFO [Listener at jenkins-hbase4.apache.org/35341] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:24,275 INFO [Listener at jenkins-hbase4.apache.org/35341] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:24,371 INFO [Listener at jenkins-hbase4.apache.org/35341] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:24,390 INFO [Listener at jenkins-hbase4.apache.org/35341] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34083 2023-07-24 18:06:24,590 WARN [Listener at jenkins-hbase4.apache.org/36813] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 18:06:24,597 WARN [Listener at jenkins-hbase4.apache.org/36813] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 18:06:24,598 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 18:06:24,606 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36681_node____.rmr8ly/webapp 2023-07-24 18:06:24,667 INFO [Listener at jenkins-hbase4.apache.org/36813] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 18:06:24,667 INFO [Listener at jenkins-hbase4.apache.org/36813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 18:06:24,667 INFO [Listener at jenkins-hbase4.apache.org/36813] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 18:06:24,667 INFO [Listener at jenkins-hbase4.apache.org/36813] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 18:06:24,676 INFO [Listener at jenkins-hbase4.apache.org/36813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:24,691 INFO [Listener at jenkins-hbase4.apache.org/36813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:24,761 INFO [Listener at jenkins-hbase4.apache.org/36813] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 18:06:24,783 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36681 2023-07-24 18:06:24,816 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 18:06:24,818 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:06:24,891 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=703, OpenFileDescriptor=894, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=173, AvailableMemoryMB=7521 2023-07-24 18:06:24,891 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=703 is superior to 500 2023-07-24 18:06:24,905 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 18:06:24,911 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 18:06:24,919 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 18:06:24,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:24,923 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:06:24,924 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 18:06:24,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:06:24,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 18:06:24,931 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:24,931 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:24,934 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce empty. 2023-07-24 18:06:24,934 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d empty. 2023-07-24 18:06:24,938 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:24,938 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:24,939 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 18:06:24,975 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 18:06:24,977 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 327cb3a3811e53781c542b57111977ce, NAME => 'testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:06:24,977 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => e8163c6e7ef3caa11995932945c4e18d, NAME => 'testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:06:25,012 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:25,014 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 327cb3a3811e53781c542b57111977ce, disabling compactions & flushes 2023-07-24 18:06:25,014 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,014 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,014 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. after waiting 0 ms 2023-07-24 18:06:25,014 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,014 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,014 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 327cb3a3811e53781c542b57111977ce: 2023-07-24 18:06:25,017 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:25,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing e8163c6e7ef3caa11995932945c4e18d, disabling compactions & flushes 2023-07-24 18:06:25,018 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. after waiting 0 ms 2023-07-24 18:06:25,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,018 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,018 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for e8163c6e7ef3caa11995932945c4e18d: 2023-07-24 18:06:25,022 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:06:25,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690221985023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690221985023"}]},"ts":"1690221985023"} 2023-07-24 18:06:25,024 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690221985023"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690221985023"}]},"ts":"1690221985023"} 2023-07-24 18:06:25,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 18:06:25,080 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:06:25,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:06:25,083 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690221985082"}]},"ts":"1690221985082"} 2023-07-24 18:06:25,085 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 18:06:25,090 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:06:25,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:06:25,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:06:25,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:06:25,092 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:06:25,093 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, ASSIGN}] 2023-07-24 18:06:25,096 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, ASSIGN 2023-07-24 18:06:25,096 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, ASSIGN 2023-07-24 18:06:25,097 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1690221975292; forceNewPlan=false, retain=false 2023-07-24 18:06:25,097 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:06:25,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 18:06:25,247 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:06:25,250 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=327cb3a3811e53781c542b57111977ce, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:25,250 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e8163c6e7ef3caa11995932945c4e18d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:25,251 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690221985250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690221985250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690221985250"}]},"ts":"1690221985250"} 2023-07-24 18:06:25,251 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690221985250"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690221985250"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690221985250"}]},"ts":"1690221985250"} 2023-07-24 18:06:25,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 327cb3a3811e53781c542b57111977ce, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:25,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure e8163c6e7ef3caa11995932945c4e18d, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:06:25,413 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:25,413 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 18:06:25,417 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 18:06:25,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 327cb3a3811e53781c542b57111977ce, NAME => 'testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 18:06:25,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. service=AccessControlService 2023-07-24 18:06:25,420 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:25,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:25,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,421 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,427 INFO [StoreOpener-327cb3a3811e53781c542b57111977ce-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e8163c6e7ef3caa11995932945c4e18d, NAME => 'testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 18:06:25,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. service=AccessControlService 2023-07-24 18:06:25,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:25,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:25,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,428 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,429 DEBUG [StoreOpener-327cb3a3811e53781c542b57111977ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf 2023-07-24 18:06:25,429 DEBUG [StoreOpener-327cb3a3811e53781c542b57111977ce-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf 2023-07-24 18:06:25,429 INFO [StoreOpener-e8163c6e7ef3caa11995932945c4e18d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,432 DEBUG [StoreOpener-e8163c6e7ef3caa11995932945c4e18d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf 2023-07-24 18:06:25,432 DEBUG [StoreOpener-e8163c6e7ef3caa11995932945c4e18d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf 2023-07-24 18:06:25,433 INFO [StoreOpener-e8163c6e7ef3caa11995932945c4e18d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e8163c6e7ef3caa11995932945c4e18d columnFamilyName cf 2023-07-24 18:06:25,433 INFO [StoreOpener-327cb3a3811e53781c542b57111977ce-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 327cb3a3811e53781c542b57111977ce columnFamilyName cf 2023-07-24 18:06:25,436 INFO [StoreOpener-e8163c6e7ef3caa11995932945c4e18d-1] regionserver.HStore(310): Store=e8163c6e7ef3caa11995932945c4e18d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:25,436 INFO [StoreOpener-327cb3a3811e53781c542b57111977ce-1] regionserver.HStore(310): Store=327cb3a3811e53781c542b57111977ce/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:25,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:25,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:25,458 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:25,459 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 327cb3a3811e53781c542b57111977ce; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69551330, jitterRate=0.03639557957649231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:25,459 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 327cb3a3811e53781c542b57111977ce: 2023-07-24 18:06:25,461 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce., pid=15, masterSystemTime=1690221985410 2023-07-24 18:06:25,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:25,470 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:25,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e8163c6e7ef3caa11995932945c4e18d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64844805, jitterRate=-0.03373710811138153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:25,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e8163c6e7ef3caa11995932945c4e18d: 2023-07-24 18:06:25,472 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=327cb3a3811e53781c542b57111977ce, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:25,472 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690221985472"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690221985472"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690221985472"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690221985472"}]},"ts":"1690221985472"} 2023-07-24 18:06:25,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d., pid=16, masterSystemTime=1690221985413 2023-07-24 18:06:25,495 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=e8163c6e7ef3caa11995932945c4e18d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:25,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 18:06:25,500 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690221985495"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690221985495"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690221985495"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690221985495"}]},"ts":"1690221985495"} 2023-07-24 18:06:25,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 327cb3a3811e53781c542b57111977ce, server=jenkins-hbase4.apache.org,42037,1690221975401 in 240 msec 2023-07-24 18:06:25,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:25,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, ASSIGN in 411 msec 2023-07-24 18:06:25,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 18:06:25,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure e8163c6e7ef3caa11995932945c4e18d, server=jenkins-hbase4.apache.org,34839,1690221975292 in 255 msec 2023-07-24 18:06:25,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-24 18:06:25,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, ASSIGN in 421 msec 2023-07-24 18:06:25,520 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:06:25,520 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690221985520"}]},"ts":"1690221985520"} 2023-07-24 18:06:25,522 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 18:06:25,526 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:06:25,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 18:06:25,533 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 18:06:25,554 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 18:06:25,591 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:25,591 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:25,591 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:25,591 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:25,592 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:06:25,600 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:25,600 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:25,600 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:25,600 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:25,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:25,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:25,601 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:25,605 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 682 msec 2023-07-24 18:06:26,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 18:06:26,034 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 18:06:26,037 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 18:06:26,038 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:26,041 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:06:26,067 DEBUG [hconnection-0x78b47ac1-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:26,074 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:26,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 18:06:26,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690221986093 (current time:1690221986093). 2023-07-24 18:06:26,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:06:26,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x7371fc55 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:26,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@366842d3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:26,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:26,105 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:26,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7371fc55 to 127.0.0.1:57118 2023-07-24 18:06:26,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:26,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x1b867171 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:26,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76015b3b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:26,120 DEBUG [hconnection-0x3ae8f32e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:26,124 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:26,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b867171 to 127.0.0.1:57118 2023-07-24 18:06:26,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:26,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 18:06:26,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:06:26,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 18:06:26,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 18:06:26,178 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 18:06:26,180 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690222586180 2023-07-24 18:06:26,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 18:06:26,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 18:06:26,186 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 18:06:26,188 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:06:26,188 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:06:26,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-24 18:06:26,190 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 18:06:26,192 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 18:06:26,194 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690222586194 2023-07-24 18:06:26,226 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,227 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 18:06:26,227 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:26,229 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 18:06:26,229 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 18:06:26,229 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,229 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,237 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:26,237 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:26,237 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:26,237 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:26,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:26,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:26,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:26,238 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,238 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,239 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,239 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,239 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:06:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 18:06:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 18:06:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 18:06:26,240 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 18:06:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,242 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 18:06:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,248 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 18:06:26,249 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,249 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 18:06:26,250 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:26,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 18:06:26,257 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 18:06:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 18:06:26,258 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 18:06:26,259 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 18:06:26,260 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 18:06:26,261 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 18:06:26,261 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 18:06:26,261 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:26,264 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 18:06:26,264 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 18:06:26,264 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 18:06:26,267 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,267 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:26,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:26,268 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,269 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,269 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,269 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,269 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,269 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:26,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:26,269 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:26,270 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,270 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:26,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:26,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:26,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 18:06:26,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2893659[Count = 1] remaining members to acquire global barrier 2023-07-24 18:06:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:26,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:26,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 18:06:26,277 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2893659[Count = 0] remaining members to acquire global barrier 2023-07-24 18:06:26,277 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 18:06:26,277 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,281 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 18:06:26,281 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,281 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,281 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:06:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:26,282 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:26,282 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:26,282 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. started... 2023-07-24 18:06:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 18:06:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 18:06:26,283 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:06:26,286 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 18:06:26,288 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:26,288 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8163c6e7ef3caa11995932945c4e18d: 2023-07-24 18:06:26,290 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,291 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:26,292 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:26,292 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:26,292 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. started... 2023-07-24 18:06:26,292 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 18:06:26,293 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:26,293 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 18:06:26,293 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 327cb3a3811e53781c542b57111977ce: 2023-07-24 18:06:26,293 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:26,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:26,296 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:06:26,299 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:26,299 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:26,304 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:06:26,304 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:06:26,497 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:26,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:26,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:26,498 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:06:26,780 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. completed. 2023-07-24 18:06:26,780 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:26,780 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:26,780 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:26,781 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,781 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 18:06:26,781 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:06:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 18:06:26,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:26,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,783 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 18:06:26,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:26,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:26,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:26,786 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. completed. 2023-07-24 18:06:26,786 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 18:06:26,786 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:06:26,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,787 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,788 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 18:06:26,788 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:26,788 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 18:06:26,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:06:26,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 18:06:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:26,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:26,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:26,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:06:26,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 18:06:26,797 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 18:06:26,797 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:06:26,797 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:06:26,797 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,797 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:06:26,799 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:26,800 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:26,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,800 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:26,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:26,801 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:26,801 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:26,801 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,801 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:26,801 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:06:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:26,802 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:26,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,802 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,805 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:26,805 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,806 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:26,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:26,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:26,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:26,819 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:26,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:26,820 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:26,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:26,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,820 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,820 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:26,820 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 18:06:26,821 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:26,821 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:26,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:26,822 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:06:26,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:26,821 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:26,822 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:26,822 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:26,822 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,822 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,823 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 18:06:26,842 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,844 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,912 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,963 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 18:06:26,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,964 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:26,964 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690221986183Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690221986841 (+658 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690221986842 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690221986842Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690221986855 (+13 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690221986889 (+34 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690221986963 (+74 ms) 2023-07-24 18:06:26,967 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 18:06:26,969 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 781 msec 2023-07-24 18:06:27,301 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:27,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:27,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:06:27,321 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42037] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:06:27,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:06:27,329 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 18:06:27,329 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:27,329 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:06:27,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 18:06:27,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690221987345 (current time:1690221987345). 2023-07-24 18:06:27,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:06:27,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x744739e2 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:27,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ff9e2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:27,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:27,356 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:27,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x744739e2 to 127.0.0.1:57118 2023-07-24 18:06:27,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:27,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x71638b5e to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:27,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c2634b9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:27,364 DEBUG [hconnection-0x28bcfbd0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:27,366 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:27,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71638b5e to 127.0.0.1:57118 2023-07-24 18:06:27,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:27,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 18:06:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:06:27,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 18:06:27,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 18:06:27,375 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 18:06:27,376 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690222587376 2023-07-24 18:06:27,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 18:06:27,376 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 18:06:27,377 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:06:27,378 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:06:27,379 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 18:06:27,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 18:06:27,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 6 msec 2023-07-24 18:06:27,381 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 18:06:27,382 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690222587382 2023-07-24 18:06:27,398 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 18:06:27,399 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 18:06:27,399 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:27,399 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 18:06:27,399 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 18:06:27,400 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,400 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,401 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,401 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:27,401 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:27,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:27,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:27,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:27,401 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:27,402 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:27,402 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:27,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:27,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,402 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,402 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:06:27,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,402 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 18:06:27,403 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 18:06:27,403 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 18:06:27,404 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:27,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 18:06:27,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,405 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 18:06:27,405 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 18:06:27,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 18:06:27,405 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 18:06:27,405 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 18:06:27,405 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 18:06:27,405 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:27,405 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 18:06:27,406 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 18:06:27,406 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 18:06:27,406 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 18:06:27,406 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 18:06:27,406 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:27,407 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 18:06:27,407 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 18:06:27,407 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 18:06:27,410 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,410 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,410 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:27,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,411 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:27,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:27,411 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,412 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:27,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51040932[Count = 1] remaining members to acquire global barrier 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:27,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:27,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 18:06:27,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51040932[Count = 0] remaining members to acquire global barrier 2023-07-24 18:06:27,416 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 18:06:27,417 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 18:06:27,421 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,421 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 18:06:27,422 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:27,421 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:27,422 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:27,422 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. started... 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:06:27,422 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. started... 2023-07-24 18:06:27,422 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,422 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:06:27,422 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e8163c6e7ef3caa11995932945c4e18d 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-24 18:06:27,422 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 327cb3a3811e53781c542b57111977ce 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-24 18:06:27,422 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 18:06:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:27,424 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 18:06:27,478 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:27,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:27,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:27,480 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:06:27,566 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307247ca6a5a61ea24d748b4d3b9c1e090d5e to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307247ca6a5a61ea24d748b4d3b9c1e090d5e 2023-07-24 18:06:27,566 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307246509497b958a4630941819230c83181f to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307246509497b958a4630941819230c83181f 2023-07-24 18:06:27,611 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/.tmp/cf/16a6d78a03b144859d7572aa43eb9427 2023-07-24 18:06:27,612 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/.tmp/cf/4aab0dc1b36f45f3a0e3a5b74631a69d 2023-07-24 18:06:27,625 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/.tmp/cf/16a6d78a03b144859d7572aa43eb9427 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf/16a6d78a03b144859d7572aa43eb9427 2023-07-24 18:06:27,625 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/.tmp/cf/4aab0dc1b36f45f3a0e3a5b74631a69d as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf/4aab0dc1b36f45f3a0e3a5b74631a69d 2023-07-24 18:06:27,639 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf/16a6d78a03b144859d7572aa43eb9427, entries=6, sequenceid=6, filesize=5.9 K 2023-07-24 18:06:27,643 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 327cb3a3811e53781c542b57111977ce in 221ms, sequenceid=6, compaction requested=false 2023-07-24 18:06:27,644 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 18:06:27,644 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 327cb3a3811e53781c542b57111977ce: 2023-07-24 18:06:27,645 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 18:06:27,645 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:27,645 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf/16a6d78a03b144859d7572aa43eb9427] hfiles 2023-07-24 18:06:27,645 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf/16a6d78a03b144859d7572aa43eb9427 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 18:06:27,648 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf/4aab0dc1b36f45f3a0e3a5b74631a69d, entries=44, sequenceid=6, filesize=12.3 K 2023-07-24 18:06:27,654 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for e8163c6e7ef3caa11995932945c4e18d in 232ms, sequenceid=6, compaction requested=false 2023-07-24 18:06:27,657 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e8163c6e7ef3caa11995932945c4e18d: 2023-07-24 18:06:27,657 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 18:06:27,658 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:27,658 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf/4aab0dc1b36f45f3a0e3a5b74631a69d] hfiles 2023-07-24 18:06:27,658 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf/4aab0dc1b36f45f3a0e3a5b74631a69d for snapshot=snaptb0-testExportWithTargetName 2023-07-24 18:06:27,680 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:27,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:27,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:27,682 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:06:27,697 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. completed. 2023-07-24 18:06:27,697 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. completed. 2023-07-24 18:06:27,697 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:27,700 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 18:06:27,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:06:27,701 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 18:06:27,702 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:27,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:27,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:27,702 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 18:06:27,704 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:27,704 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 18:06:27,704 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:27,704 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 18:06:27,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:06:27,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 18:06:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:27,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:06:27,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 18:06:27,716 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 18:06:27,717 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:06:27,717 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:06:27,717 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 18:06:27,717 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:06:27,721 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,721 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:27,721 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:27,721 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:27,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,721 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:27,722 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:27,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:27,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:27,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,724 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:27,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 18:06:27,727 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,729 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,733 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,733 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:27,746 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:27,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:27,747 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:27,747 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:27,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:27,746 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 18:06:27,746 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:27,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:27,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 18:06:27,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:27,747 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 18:06:27,747 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:27,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:06:27,748 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:27,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:27,748 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:27,748 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:27,748 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:27,748 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,749 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:27,749 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:27,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:27,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:27,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307246509497b958a4630941819230c83181f, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307247ca6a5a61ea24d748b4d3b9c1e090d5e] mob files 2023-07-24 18:06:27,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307246509497b958a4630941819230c83181f 2023-07-24 18:06:27,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307247ca6a5a61ea24d748b4d3b9c1e090d5e 2023-07-24 18:06:27,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 18:06:27,767 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,835 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 18:06:27,835 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,835 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 18:06:27,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690221987376Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690221987766 (+390 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690221987766Loading Region manifests for snaptb0-testExportWithTargetName at 1690221987767 (+1 ms)Writing data manifest for snaptb0-testExportWithTargetName at 1690221987771 (+4 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690221987789 (+18 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690221987835 (+46 ms) 2023-07-24 18:06:27,837 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 18:06:27,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 461 msec 2023-07-24 18:06:27,982 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:27,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 18:06:27,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:06:27,985 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985 2023-07-24 18:06:27,986 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35665, tgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985, rawTgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:28,025 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:28,025 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-629486833_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 18:06:28,025 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 18:06:28,044 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 18:06:28,124 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,125 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,126 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,126 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,127 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,127 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,127 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,231 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-520731786939345173.jar 2023-07-24 18:06:28,232 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,232 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,233 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,234 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,234 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,235 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:28,236 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:06:28,236 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:06:28,237 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:06:28,238 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:06:28,238 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:06:28,239 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:06:28,240 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:06:28,240 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:06:28,241 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:06:28,242 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:06:28,246 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:28,246 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:28,247 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:06:28,247 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:28,248 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:28,248 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:06:28,249 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:06:29,031 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:06:29,038 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 18:06:29,047 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 18:06:29,594 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:06:29,595 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:06:29,993 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0001_000001 (auth:SIMPLE) 2023-07-24 18:06:30,957 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:06:35,239 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0001_000001 (auth:SIMPLE) 2023-07-24 18:06:37,509 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0001_000001 (auth:SIMPLE) 2023-07-24 18:06:43,019 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:06:43,022 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:06:43,033 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 18:06:43,033 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:06:43,034 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:06:43,034 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 18:06:43,034 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 18:06:43,034 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 18:06:43,034 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985/.hbase-snapshot/testExportWithTargetName 2023-07-24 18:06:43,035 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 18:06:43,035 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690221987985/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 18:06:43,045 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 18:06:43,050 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 18:06:43,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,065 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222003065"}]},"ts":"1690222003065"} 2023-07-24 18:06:43,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 18:06:43,067 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 18:06:43,069 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 18:06:43,071 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, UNASSIGN}] 2023-07-24 18:06:43,074 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, UNASSIGN 2023-07-24 18:06:43,074 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, UNASSIGN 2023-07-24 18:06:43,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=327cb3a3811e53781c542b57111977ce, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:43,075 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e8163c6e7ef3caa11995932945c4e18d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:43,076 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690222003075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222003075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222003075"}]},"ts":"1690222003075"} 2023-07-24 18:06:43,076 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690222003075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222003075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222003075"}]},"ts":"1690222003075"} 2023-07-24 18:06:43,089 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure e8163c6e7ef3caa11995932945c4e18d, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:06:43,090 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 327cb3a3811e53781c542b57111977ce, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:43,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 18:06:43,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:43,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e8163c6e7ef3caa11995932945c4e18d, disabling compactions & flushes 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 327cb3a3811e53781c542b57111977ce, disabling compactions & flushes 2023-07-24 18:06:43,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:43,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. after waiting 0 ms 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. after waiting 0 ms 2023-07-24 18:06:43,257 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:43,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:06:43,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:06:43,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:43,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:43,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d. 2023-07-24 18:06:43,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce. 2023-07-24 18:06:43,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e8163c6e7ef3caa11995932945c4e18d: 2023-07-24 18:06:43,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 327cb3a3811e53781c542b57111977ce: 2023-07-24 18:06:43,275 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:43,276 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=327cb3a3811e53781c542b57111977ce, regionState=CLOSED 2023-07-24 18:06:43,276 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690222003276"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222003276"}]},"ts":"1690222003276"} 2023-07-24 18:06:43,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:43,277 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=e8163c6e7ef3caa11995932945c4e18d, regionState=CLOSED 2023-07-24 18:06:43,277 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690222003277"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222003277"}]},"ts":"1690222003277"} 2023-07-24 18:06:43,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-24 18:06:43,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 327cb3a3811e53781c542b57111977ce, server=jenkins-hbase4.apache.org,42037,1690221975401 in 188 msec 2023-07-24 18:06:43,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-24 18:06:43,283 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure e8163c6e7ef3caa11995932945c4e18d, server=jenkins-hbase4.apache.org,34839,1690221975292 in 190 msec 2023-07-24 18:06:43,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=327cb3a3811e53781c542b57111977ce, UNASSIGN in 210 msec 2023-07-24 18:06:43,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-24 18:06:43,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=e8163c6e7ef3caa11995932945c4e18d, UNASSIGN in 212 msec 2023-07-24 18:06:43,286 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222003286"}]},"ts":"1690222003286"} 2023-07-24 18:06:43,288 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 18:06:43,289 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 18:06:43,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 237 msec 2023-07-24 18:06:43,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 18:06:43,368 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 18:06:43,373 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 18:06:43,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 18:06:43,384 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,388 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 18:06:43,391 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:43,391 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:43,392 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,392 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,392 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,392 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 18:06:43,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 18:06:43,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 18:06:43,393 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 18:06:43,394 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:43,396 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/recovered.edits] 2023-07-24 18:06:43,396 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/recovered.edits] 2023-07-24 18:06:43,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 18:06:43,404 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf/16a6d78a03b144859d7572aa43eb9427 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/cf/16a6d78a03b144859d7572aa43eb9427 2023-07-24 18:06:43,405 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf/4aab0dc1b36f45f3a0e3a5b74631a69d to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/cf/4aab0dc1b36f45f3a0e3a5b74631a69d 2023-07-24 18:06:43,410 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce/recovered.edits/9.seqid 2023-07-24 18:06:43,410 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d/recovered.edits/9.seqid 2023-07-24 18:06:43,411 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/327cb3a3811e53781c542b57111977ce 2023-07-24 18:06:43,411 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportWithTargetName/e8163c6e7ef3caa11995932945c4e18d 2023-07-24 18:06:43,411 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 18:06:43,412 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 18:06:43,413 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 18:06:43,417 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307246509497b958a4630941819230c83181f to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307246509497b958a4630941819230c83181f 2023-07-24 18:06:43,419 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307247ca6a5a61ea24d748b4d3b9c1e090d5e to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307247ca6a5a61ea24d748b4d3b9c1e090d5e 2023-07-24 18:06:43,419 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 18:06:43,423 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,444 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 18:06:43,446 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 18:06:43,448 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,448 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 18:06:43,449 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222003448"}]},"ts":"9223372036854775807"} 2023-07-24 18:06:43,449 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222003448"}]},"ts":"9223372036854775807"} 2023-07-24 18:06:43,451 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 18:06:43,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 327cb3a3811e53781c542b57111977ce, NAME => 'testtb-testExportWithTargetName,,1690221984918.327cb3a3811e53781c542b57111977ce.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e8163c6e7ef3caa11995932945c4e18d, NAME => 'testtb-testExportWithTargetName,1,1690221984918.e8163c6e7ef3caa11995932945c4e18d.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 18:06:43,451 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 18:06:43,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222003451"}]},"ts":"9223372036854775807"} 2023-07-24 18:06:43,453 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 18:06:43,455 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 18:06:43,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 81 msec 2023-07-24 18:06:43,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 18:06:43,500 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 18:06:43,518 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 18:06:43,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 18:06:43,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 18:06:43,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 18:06:43,557 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=753 (was 703) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35341 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:57664 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:34705 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:42446 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1371599256_1 at /127.0.0.1:42422 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1312 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:41757 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1371599256_1 at /127.0.0.1:57634 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:34370 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 894) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=413 (was 341) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 173) - ProcessCount LEAK? -, AvailableMemoryMB=5701 (was 7521) 2023-07-24 18:06:43,557 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-24 18:06:43,582 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=753, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=413, ProcessCount=179, AvailableMemoryMB=5700 2023-07-24 18:06:43,582 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=753 is superior to 500 2023-07-24 18:06:43,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 18:06:43,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:06:43,591 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:06:43,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 18:06:43,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 18:06:43,595 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:06:43,599 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,599 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,599 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b empty. 2023-07-24 18:06:43,599 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 empty. 2023-07-24 18:06:43,600 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,600 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,600 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 18:06:43,614 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 18:06:43,616 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7c3c19ea93141bbbe4bfee0c8ddaf47b, NAME => 'testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:06:43,616 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => e7a9969ed7b5b997e492e1a12fe96969, NAME => 'testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:06:43,638 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:43,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing e7a9969ed7b5b997e492e1a12fe96969, disabling compactions & flushes 2023-07-24 18:06:43,639 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. after waiting 0 ms 2023-07-24 18:06:43,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:43,639 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7c3c19ea93141bbbe4bfee0c8ddaf47b, disabling compactions & flushes 2023-07-24 18:06:43,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for e7a9969ed7b5b997e492e1a12fe96969: 2023-07-24 18:06:43,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. after waiting 0 ms 2023-07-24 18:06:43,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,640 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,640 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7c3c19ea93141bbbe4bfee0c8ddaf47b: 2023-07-24 18:06:43,643 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:06:43,644 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222003644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222003644"}]},"ts":"1690222003644"} 2023-07-24 18:06:43,645 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222003644"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222003644"}]},"ts":"1690222003644"} 2023-07-24 18:06:43,647 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:06:43,648 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:06:43,648 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222003648"}]},"ts":"1690222003648"} 2023-07-24 18:06:43,650 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 18:06:43,654 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:06:43,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:06:43,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:06:43,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:06:43,655 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:06:43,656 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, ASSIGN}] 2023-07-24 18:06:43,658 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, ASSIGN 2023-07-24 18:06:43,658 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, ASSIGN 2023-07-24 18:06:43,659 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1690221975292; forceNewPlan=false, retain=false 2023-07-24 18:06:43,659 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:06:43,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 18:06:43,809 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:06:43,812 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e7a9969ed7b5b997e492e1a12fe96969, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:43,812 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7c3c19ea93141bbbe4bfee0c8ddaf47b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:43,812 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222003812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222003812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222003812"}]},"ts":"1690222003812"} 2023-07-24 18:06:43,812 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222003812"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222003812"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222003812"}]},"ts":"1690222003812"} 2023-07-24 18:06:43,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 7c3c19ea93141bbbe4bfee0c8ddaf47b, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:06:43,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure e7a9969ed7b5b997e492e1a12fe96969, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:43,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 18:06:43,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c3c19ea93141bbbe4bfee0c8ddaf47b, NAME => 'testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 18:06:43,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e7a9969ed7b5b997e492e1a12fe96969, NAME => 'testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 18:06:43,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. service=AccessControlService 2023-07-24 18:06:43,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. service=AccessControlService 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,973 INFO [StoreOpener-7c3c19ea93141bbbe4bfee0c8ddaf47b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,973 INFO [StoreOpener-e7a9969ed7b5b997e492e1a12fe96969-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,975 DEBUG [StoreOpener-7c3c19ea93141bbbe4bfee0c8ddaf47b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf 2023-07-24 18:06:43,975 DEBUG [StoreOpener-7c3c19ea93141bbbe4bfee0c8ddaf47b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf 2023-07-24 18:06:43,975 DEBUG [StoreOpener-e7a9969ed7b5b997e492e1a12fe96969-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf 2023-07-24 18:06:43,975 DEBUG [StoreOpener-e7a9969ed7b5b997e492e1a12fe96969-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf 2023-07-24 18:06:43,975 INFO [StoreOpener-7c3c19ea93141bbbe4bfee0c8ddaf47b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c3c19ea93141bbbe4bfee0c8ddaf47b columnFamilyName cf 2023-07-24 18:06:43,975 INFO [StoreOpener-e7a9969ed7b5b997e492e1a12fe96969-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e7a9969ed7b5b997e492e1a12fe96969 columnFamilyName cf 2023-07-24 18:06:43,977 INFO [StoreOpener-e7a9969ed7b5b997e492e1a12fe96969-1] regionserver.HStore(310): Store=e7a9969ed7b5b997e492e1a12fe96969/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:43,977 INFO [StoreOpener-7c3c19ea93141bbbe4bfee0c8ddaf47b-1] regionserver.HStore(310): Store=7c3c19ea93141bbbe4bfee0c8ddaf47b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:06:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:43,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:43,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:43,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:06:43,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e7a9969ed7b5b997e492e1a12fe96969; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59099446, jitterRate=-0.11934962868690491}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:43,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c3c19ea93141bbbe4bfee0c8ddaf47b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67829470, jitterRate=0.010737866163253784}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:06:43,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e7a9969ed7b5b997e492e1a12fe96969: 2023-07-24 18:06:43,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c3c19ea93141bbbe4bfee0c8ddaf47b: 2023-07-24 18:06:43,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969., pid=31, masterSystemTime=1690222003967 2023-07-24 18:06:43,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b., pid=30, masterSystemTime=1690222003967 2023-07-24 18:06:43,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:43,990 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=e7a9969ed7b5b997e492e1a12fe96969, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:43,990 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222003990"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222003990"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222003990"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222003990"}]},"ts":"1690222003990"} 2023-07-24 18:06:43,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:43,991 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7c3c19ea93141bbbe4bfee0c8ddaf47b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:43,993 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222003991"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222003991"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222003991"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222003991"}]},"ts":"1690222003991"} 2023-07-24 18:06:43,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 18:06:43,997 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure e7a9969ed7b5b997e492e1a12fe96969, server=jenkins-hbase4.apache.org,42037,1690221975401 in 178 msec 2023-07-24 18:06:43,999 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 18:06:44,003 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 7c3c19ea93141bbbe4bfee0c8ddaf47b, server=jenkins-hbase4.apache.org,34839,1690221975292 in 182 msec 2023-07-24 18:06:44,003 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, ASSIGN in 341 msec 2023-07-24 18:06:44,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 18:06:44,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, ASSIGN in 347 msec 2023-07-24 18:06:44,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:06:44,007 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222004007"}]},"ts":"1690222004007"} 2023-07-24 18:06:44,009 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 18:06:44,012 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:06:44,012 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 18:06:44,014 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 18:06:44,016 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:44,016 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:44,016 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:44,016 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:06:44,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:44,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:44,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:44,018 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:06:44,020 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 432 msec 2023-07-24 18:06:44,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 18:06:44,198 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 18:06:44,201 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 18:06:44,202 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:44,206 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:06:44,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:06:44,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222004242 (current time:1690222004242). 2023-07-24 18:06:44,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:06:44,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x666fb33b to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:44,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3606fe6f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:44,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:44,274 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46646, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:44,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x666fb33b to 127.0.0.1:57118 2023-07-24 18:06:44,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:44,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x6242c953 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:44,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79af484b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:44,296 DEBUG [hconnection-0x785b2497-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:44,298 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:44,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6242c953 to 127.0.0.1:57118 2023-07-24 18:06:44,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:44,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 18:06:44,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:06:44,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:06:44,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:06:44,312 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:06:44,313 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690222604313 2023-07-24 18:06:44,313 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 18:06:44,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:06:44,315 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:06:44,315 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:06:44,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 18:06:44,319 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:06:44,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 18:06:44,322 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 18:06:44,325 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690222604325 2023-07-24 18:06:44,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,352 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 18:06:44,352 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,353 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 18:06:44,353 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 18:06:44,410 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,410 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,413 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,413 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,413 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,413 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,413 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,413 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,414 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,414 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:06:44,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,414 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 18:06:44,415 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 18:06:44,415 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 18:06:44,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,415 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,415 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 18:06:44,415 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 18:06:44,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,417 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 18:06:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 18:06:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 18:06:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 18:06:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 18:06:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 18:06:44,418 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,419 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 18:06:44,419 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 18:06:44,419 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 18:06:44,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:06:44,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:44,420 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:06:44,421 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,421 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,429 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,430 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:44,430 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,431 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 18:06:44,432 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e46c8d[Count = 1] remaining members to acquire global barrier 2023-07-24 18:06:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 18:06:44,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e46c8d[Count = 0] remaining members to acquire global barrier 2023-07-24 18:06:44,435 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 18:06:44,435 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,436 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,436 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,436 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:06:44,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,437 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:44,437 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:44,437 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,437 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:06:44,437 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:44,437 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. started... 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:06:44,437 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. started... 2023-07-24 18:06:44,437 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:44,438 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c3c19ea93141bbbe4bfee0c8ddaf47b: 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7a9969ed7b5b997e492e1a12fe96969: 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:44,439 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:06:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 18:06:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:44,440 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 18:06:44,469 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. completed. 2023-07-24 18:06:44,469 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 18:06:44,469 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:06:44,470 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. completed. 2023-07-24 18:06:44,470 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 18:06:44,470 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:06:44,472 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 18:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:44,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,472 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 18:06:44,474 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 18:06:44,474 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:44,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,474 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 18:06:44,474 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:06:44,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 18:06:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:06:44,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 18:06:44,484 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 18:06:44,485 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:06:44,485 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:06:44,485 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,485 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:06:44,486 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:44,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,487 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,486 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:44,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,488 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,488 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,489 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,495 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,496 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,496 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:44,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:44,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,500 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 18:06:44,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:06:44,499 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,499 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,501 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,502 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:44,502 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,503 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:44,503 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:44,517 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,518 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,587 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 18:06:44,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,587 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 18:06:44,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690222004313Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690222004517 (+204 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690222004517Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690222004517Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690222004522 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690222004545 (+23 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690222004587 (+42 ms) 2023-07-24 18:06:44,591 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 18:06:44,593 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 277 msec 2023-07-24 18:06:44,620 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:44,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:06:44,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:06:44,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:06:44,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:06:44,632 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 18:06:44,632 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:44,633 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:06:44,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:06:44,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222004644 (current time:1690222004644). 2023-07-24 18:06:44,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:06:44,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x31315a0a to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:44,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e4d7ea7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:44,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:44,657 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:44,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x31315a0a to 127.0.0.1:57118 2023-07-24 18:06:44,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:44,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x2499df16 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:06:44,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e3864d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:06:44,669 DEBUG [hconnection-0x4e629abd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:06:44,671 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:06:44,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2499df16 to 127.0.0.1:57118 2023-07-24 18:06:44,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:06:44,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 18:06:44,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:06:44,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:06:44,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:06:44,681 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:06:44,682 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690222604682 2023-07-24 18:06:44,682 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 18:06:44,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:06:44,684 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:06:44,684 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:06:44,685 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:06:44,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 18:06:44,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 18:06:44,689 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 18:06:44,690 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690222604690 2023-07-24 18:06:44,703 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 18:06:44,703 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 18:06:44,703 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,705 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 18:06:44,705 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 18:06:44,706 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,706 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,728 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,728 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,728 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,728 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:44,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,729 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,729 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,729 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,729 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 18:06:44,730 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 18:06:44,730 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 18:06:44,734 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 18:06:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 18:06:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 18:06:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 18:06:44,735 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 18:06:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 18:06:44,735 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:06:44,736 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 18:06:44,737 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 18:06:44,737 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 18:06:44,737 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 18:06:44,737 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 18:06:44,737 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 18:06:44,767 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,784 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:44,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:06:44,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:44,786 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:06:44,820 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,820 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:44,821 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,821 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:06:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d94a9f6[Count = 1] remaining members to acquire global barrier 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:44,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:44,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:44,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 18:06:44,825 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d94a9f6[Count = 0] remaining members to acquire global barrier 2023-07-24 18:06:44,825 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 18:06:44,825 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:06:44,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,868 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:44,868 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:06:44,868 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:44,868 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:44,868 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:44,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:44,869 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:44,869 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:06:44,869 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. started... 2023-07-24 18:06:44,868 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:06:44,869 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:06:44,869 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:44,869 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:06:44,869 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 18:06:44,869 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. started... 2023-07-24 18:06:44,869 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:06:44,869 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7c3c19ea93141bbbe4bfee0c8ddaf47b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 18:06:44,869 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e7a9969ed7b5b997e492e1a12fe96969 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 18:06:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 18:06:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:44,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 18:06:44,901 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307247e89cbddcc2e4282890e0630e4d32146 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307247e89cbddcc2e4282890e0630e4d32146 2023-07-24 18:06:44,904 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072435cd8b62df91497082569c16ea78043d to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072435cd8b62df91497082569c16ea78043d 2023-07-24 18:06:44,946 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/.tmp/cf/f3f6a3d19c9346d584366fa811ed1813 2023-07-24 18:06:44,954 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/.tmp/cf/f3f6a3d19c9346d584366fa811ed1813 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf/f3f6a3d19c9346d584366fa811ed1813 2023-07-24 18:06:44,962 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf/f3f6a3d19c9346d584366fa811ed1813, entries=5, sequenceid=6, filesize=5.7 K 2023-07-24 18:06:44,963 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 7c3c19ea93141bbbe4bfee0c8ddaf47b in 94ms, sequenceid=6, compaction requested=false 2023-07-24 18:06:44,963 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 18:06:44,964 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7c3c19ea93141bbbe4bfee0c8ddaf47b: 2023-07-24 18:06:44,964 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 18:06:44,964 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:44,964 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf/f3f6a3d19c9346d584366fa811ed1813] hfiles 2023-07-24 18:06:44,964 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf/f3f6a3d19c9346d584366fa811ed1813 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 18:06:44,976 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/.tmp/cf/ac1ee8e134224d4dbc1bae513126f5ad 2023-07-24 18:06:44,984 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/.tmp/cf/ac1ee8e134224d4dbc1bae513126f5ad as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf/ac1ee8e134224d4dbc1bae513126f5ad 2023-07-24 18:06:44,986 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:44,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:06:44,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:06:44,987 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:06:44,990 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf/ac1ee8e134224d4dbc1bae513126f5ad, entries=45, sequenceid=6, filesize=12.5 K 2023-07-24 18:06:44,994 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for e7a9969ed7b5b997e492e1a12fe96969 in 125ms, sequenceid=6, compaction requested=false 2023-07-24 18:06:44,997 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e7a9969ed7b5b997e492e1a12fe96969: 2023-07-24 18:06:44,997 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 18:06:44,997 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:06:44,997 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf/ac1ee8e134224d4dbc1bae513126f5ad] hfiles 2023-07-24 18:06:44,997 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf/ac1ee8e134224d4dbc1bae513126f5ad for snapshot=snaptb0-testExportFileSystemState 2023-07-24 18:06:45,000 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. completed. 2023-07-24 18:06:45,000 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:45,001 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:45,001 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:45,001 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,001 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 18:06:45,001 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:06:45,011 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,011 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 18:06:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:45,011 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:45,011 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 18:06:45,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:45,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:45,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:06:45,019 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 18:06:45,020 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. completed. 2023-07-24 18:06:45,020 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:06:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:06:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 18:06:45,020 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:06:45,022 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,022 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 18:06:45,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:45,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:45,022 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:45,023 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 18:06:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:45,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:45,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:06:45,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 18:06:45,029 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 18:06:45,029 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:06:45,029 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:06:45,029 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 18:06:45,029 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:06:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:45,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:45,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:45,031 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,032 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:45,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:45,033 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,034 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,035 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,036 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:06:45,036 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 18:06:45,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:45,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:45,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:45,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:45,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,043 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:06:45,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:06:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:06:45,042 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:45,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 18:06:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,043 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:45,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:45,043 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 18:06:45,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:06:45,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:06:45,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 18:06:45,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:06:45,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072435cd8b62df91497082569c16ea78043d, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307247e89cbddcc2e4282890e0630e4d32146] mob files 2023-07-24 18:06:45,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072435cd8b62df91497082569c16ea78043d 2023-07-24 18:06:45,046 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307247e89cbddcc2e4282890e0630e4d32146 2023-07-24 18:06:45,058 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 18:06:45,059 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,121 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 18:06:45,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,122 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690222004682Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690222005058 (+376 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690222005058Loading Region manifests for snaptb0-testExportFileSystemState at 1690222005058Writing data manifest for snaptb0-testExportFileSystemState at 1690222005063 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690222005079 (+16 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690222005121 (+42 ms) 2023-07-24 18:06:45,125 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 18:06:45,127 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 442 msec 2023-07-24 18:06:45,288 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:06:45,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:06:45,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:06:45,289 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289 2023-07-24 18:06:45,289 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35665, tgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289, rawTgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:45,315 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:06:45,315 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1068317465_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,315 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 18:06:45,333 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 18:06:45,363 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,363 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,364 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,364 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,365 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,365 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,365 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,446 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-3743714690383645036.jar 2023-07-24 18:06:45,446 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,447 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,447 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,448 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,448 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,448 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:06:45,449 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:06:45,449 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:06:45,449 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:06:45,450 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:06:45,450 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:06:45,450 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:06:45,451 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:06:45,451 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:06:45,451 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:06:45,452 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:06:45,452 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:45,453 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:45,453 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:06:45,453 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:45,453 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:06:45,454 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:06:45,454 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:06:46,437 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:06:46,440 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 18:06:46,442 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 18:06:47,808 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:06:47,808 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:06:47,815 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0001_000001 (auth:SIMPLE) 2023-07-24 18:06:48,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0002_000001 (auth:SIMPLE) 2023-07-24 18:06:48,873 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:06:52,600 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0002_000001 (auth:SIMPLE) 2023-07-24 18:06:54,821 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0002_000001 (auth:SIMPLE) 2023-07-24 18:06:58,253 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0002_000001 (auth:SIMPLE) 2023-07-24 18:06:59,700 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:06:59,701 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:06:59,709 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 18:06:59,710 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:06:59,710 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:06:59,710 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 18:06:59,711 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 18:06:59,711 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 18:06:59,711 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 18:06:59,711 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 18:06:59,712 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222005289/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 18:06:59,719 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 18:06:59,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 18:06:59,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:06:59,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 18:06:59,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222019725"}]},"ts":"1690222019725"} 2023-07-24 18:06:59,726 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 18:06:59,728 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 18:06:59,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, UNASSIGN}] 2023-07-24 18:06:59,731 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, UNASSIGN 2023-07-24 18:06:59,731 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, UNASSIGN 2023-07-24 18:06:59,732 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7c3c19ea93141bbbe4bfee0c8ddaf47b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:06:59,732 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e7a9969ed7b5b997e492e1a12fe96969, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:06:59,732 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222019732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222019732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222019732"}]},"ts":"1690222019732"} 2023-07-24 18:06:59,732 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222019732"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222019732"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222019732"}]},"ts":"1690222019732"} 2023-07-24 18:06:59,733 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 7c3c19ea93141bbbe4bfee0c8ddaf47b, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:06:59,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure e7a9969ed7b5b997e492e1a12fe96969, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:06:59,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 18:06:59,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:59,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c3c19ea93141bbbe4bfee0c8ddaf47b, disabling compactions & flushes 2023-07-24 18:06:59,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:59,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:59,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. after waiting 0 ms 2023-07-24 18:06:59,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:59,888 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:59,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e7a9969ed7b5b997e492e1a12fe96969, disabling compactions & flushes 2023-07-24 18:06:59,890 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:59,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:59,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. after waiting 0 ms 2023-07-24 18:06:59,890 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:59,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:06:59,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:06:59,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:59,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:06:59,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b. 2023-07-24 18:06:59,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969. 2023-07-24 18:06:59,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e7a9969ed7b5b997e492e1a12fe96969: 2023-07-24 18:06:59,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c3c19ea93141bbbe4bfee0c8ddaf47b: 2023-07-24 18:06:59,921 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:06:59,921 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=e7a9969ed7b5b997e492e1a12fe96969, regionState=CLOSED 2023-07-24 18:06:59,922 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222019921"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222019921"}]},"ts":"1690222019921"} 2023-07-24 18:06:59,922 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:06:59,922 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7c3c19ea93141bbbe4bfee0c8ddaf47b, regionState=CLOSED 2023-07-24 18:06:59,922 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690222019922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222019922"}]},"ts":"1690222019922"} 2023-07-24 18:06:59,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 18:06:59,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure e7a9969ed7b5b997e492e1a12fe96969, server=jenkins-hbase4.apache.org,42037,1690221975401 in 190 msec 2023-07-24 18:06:59,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=e7a9969ed7b5b997e492e1a12fe96969, UNASSIGN in 198 msec 2023-07-24 18:06:59,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 18:06:59,931 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 7c3c19ea93141bbbe4bfee0c8ddaf47b, server=jenkins-hbase4.apache.org,34839,1690221975292 in 195 msec 2023-07-24 18:06:59,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-24 18:06:59,933 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7c3c19ea93141bbbe4bfee0c8ddaf47b, UNASSIGN in 201 msec 2023-07-24 18:06:59,934 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222019934"}]},"ts":"1690222019934"} 2023-07-24 18:06:59,935 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 18:06:59,937 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 18:06:59,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-24 18:07:00,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 18:07:00,027 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 18:07:00,028 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 18:07:00,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:07:00,032 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:07:00,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 18:07:00,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:07:00,034 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 18:07:00,038 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:07:00,038 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:07:00,038 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,038 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,038 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,038 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 18:07:00,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 18:07:00,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 18:07:00,039 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 18:07:00,045 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/recovered.edits] 2023-07-24 18:07:00,045 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/recovered.edits] 2023-07-24 18:07:00,049 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf/f3f6a3d19c9346d584366fa811ed1813 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/cf/f3f6a3d19c9346d584366fa811ed1813 2023-07-24 18:07:00,050 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf/ac1ee8e134224d4dbc1bae513126f5ad to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/cf/ac1ee8e134224d4dbc1bae513126f5ad 2023-07-24 18:07:00,053 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b/recovered.edits/9.seqid 2023-07-24 18:07:00,053 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969/recovered.edits/9.seqid 2023-07-24 18:07:00,053 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/7c3c19ea93141bbbe4bfee0c8ddaf47b 2023-07-24 18:07:00,053 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemState/e7a9969ed7b5b997e492e1a12fe96969 2023-07-24 18:07:00,053 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 18:07:00,054 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 18:07:00,055 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 18:07:00,058 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072435cd8b62df91497082569c16ea78043d to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072435cd8b62df91497082569c16ea78043d 2023-07-24 18:07:00,059 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307247e89cbddcc2e4282890e0630e4d32146 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307247e89cbddcc2e4282890e0630e4d32146 2023-07-24 18:07:00,060 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 18:07:00,063 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:07:00,066 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 18:07:00,069 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 18:07:00,070 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:07:00,070 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 18:07:00,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222020070"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:00,071 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222020070"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:00,073 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 18:07:00,073 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7c3c19ea93141bbbe4bfee0c8ddaf47b, NAME => 'testtb-testExportFileSystemState,,1690222003584.7c3c19ea93141bbbe4bfee0c8ddaf47b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e7a9969ed7b5b997e492e1a12fe96969, NAME => 'testtb-testExportFileSystemState,1,1690222003584.e7a9969ed7b5b997e492e1a12fe96969.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 18:07:00,073 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 18:07:00,073 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222020073"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:00,075 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 18:07:00,077 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 18:07:00,081 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 49 msec 2023-07-24 18:07:00,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 18:07:00,143 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 18:07:00,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 18:07:00,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 18:07:00,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 18:07:00,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 18:07:00,180 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=761 (was 753) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_720285095_1 at /127.0.0.1:36090 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2142 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:45866 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_720285095_1 at /127.0.0.1:45842 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:45743 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:40884 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:36122 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:36813 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=928 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=405 (was 413), ProcessCount=179 (was 179), AvailableMemoryMB=5508 (was 5700) 2023-07-24 18:07:00,181 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 18:07:00,201 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=761, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=405, ProcessCount=179, AvailableMemoryMB=5508 2023-07-24 18:07:00,201 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 18:07:00,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 18:07:00,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:00,207 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:07:00,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 18:07:00,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 18:07:00,208 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:07:00,211 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,211 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,212 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 empty. 2023-07-24 18:07:00,212 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae empty. 2023-07-24 18:07:00,212 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,213 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,213 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 18:07:00,224 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 18:07:00,226 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => bf590daeb93b61b9d191b2f1b657ebae, NAME => 'testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:00,226 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ed09e2c562042e0cd269e36b5e2b8a4, NAME => 'testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:00,244 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7ed09e2c562042e0cd269e36b5e2b8a4, disabling compactions & flushes 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing bf590daeb93b61b9d191b2f1b657ebae, disabling compactions & flushes 2023-07-24 18:07:00,245 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,245 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. after waiting 0 ms 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. after waiting 0 ms 2023-07-24 18:07:00,245 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7ed09e2c562042e0cd269e36b5e2b8a4: 2023-07-24 18:07:00,245 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,245 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for bf590daeb93b61b9d191b2f1b657ebae: 2023-07-24 18:07:00,248 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:07:00,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222020249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222020249"}]},"ts":"1690222020249"} 2023-07-24 18:07:00,249 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222020249"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222020249"}]},"ts":"1690222020249"} 2023-07-24 18:07:00,252 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:07:00,253 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:07:00,253 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222020253"}]},"ts":"1690222020253"} 2023-07-24 18:07:00,254 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 18:07:00,258 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:07:00,259 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:07:00,259 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:07:00,259 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:07:00,259 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:07:00,259 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, ASSIGN}] 2023-07-24 18:07:00,262 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, ASSIGN 2023-07-24 18:07:00,262 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, ASSIGN 2023-07-24 18:07:00,263 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:07:00,263 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1690221975292; forceNewPlan=false, retain=false 2023-07-24 18:07:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 18:07:00,413 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:07:00,416 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bf590daeb93b61b9d191b2f1b657ebae, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,416 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7ed09e2c562042e0cd269e36b5e2b8a4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,416 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222020416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222020416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222020416"}]},"ts":"1690222020416"} 2023-07-24 18:07:00,416 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222020416"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222020416"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222020416"}]},"ts":"1690222020416"} 2023-07-24 18:07:00,418 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure bf590daeb93b61b9d191b2f1b657ebae, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:07:00,419 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 7ed09e2c562042e0cd269e36b5e2b8a4, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:07:00,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 18:07:00,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bf590daeb93b61b9d191b2f1b657ebae, NAME => 'testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 18:07:00,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ed09e2c562042e0cd269e36b5e2b8a4, NAME => 'testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. service=AccessControlService 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. service=AccessControlService 2023-07-24 18:07:00,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:00,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,577 INFO [StoreOpener-bf590daeb93b61b9d191b2f1b657ebae-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,577 INFO [StoreOpener-7ed09e2c562042e0cd269e36b5e2b8a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,578 DEBUG [StoreOpener-7ed09e2c562042e0cd269e36b5e2b8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf 2023-07-24 18:07:00,578 DEBUG [StoreOpener-bf590daeb93b61b9d191b2f1b657ebae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf 2023-07-24 18:07:00,578 DEBUG [StoreOpener-7ed09e2c562042e0cd269e36b5e2b8a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf 2023-07-24 18:07:00,578 DEBUG [StoreOpener-bf590daeb93b61b9d191b2f1b657ebae-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf 2023-07-24 18:07:00,579 INFO [StoreOpener-7ed09e2c562042e0cd269e36b5e2b8a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ed09e2c562042e0cd269e36b5e2b8a4 columnFamilyName cf 2023-07-24 18:07:00,579 INFO [StoreOpener-bf590daeb93b61b9d191b2f1b657ebae-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bf590daeb93b61b9d191b2f1b657ebae columnFamilyName cf 2023-07-24 18:07:00,580 INFO [StoreOpener-7ed09e2c562042e0cd269e36b5e2b8a4-1] regionserver.HStore(310): Store=7ed09e2c562042e0cd269e36b5e2b8a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:00,580 INFO [StoreOpener-bf590daeb93b61b9d191b2f1b657ebae-1] regionserver.HStore(310): Store=bf590daeb93b61b9d191b2f1b657ebae/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:00,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,581 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,582 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,584 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:00,585 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:00,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:00,586 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:00,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bf590daeb93b61b9d191b2f1b657ebae; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59295546, jitterRate=-0.11642751097679138}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:00,587 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ed09e2c562042e0cd269e36b5e2b8a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72556118, jitterRate=0.08117040991783142}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:00,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bf590daeb93b61b9d191b2f1b657ebae: 2023-07-24 18:07:00,587 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ed09e2c562042e0cd269e36b5e2b8a4: 2023-07-24 18:07:00,588 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4., pid=46, masterSystemTime=1690222020570 2023-07-24 18:07:00,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,591 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7ed09e2c562042e0cd269e36b5e2b8a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,591 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222020590"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222020590"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222020590"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222020590"}]},"ts":"1690222020590"} 2023-07-24 18:07:00,595 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae., pid=45, masterSystemTime=1690222020570 2023-07-24 18:07:00,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 18:07:00,595 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 7ed09e2c562042e0cd269e36b5e2b8a4, server=jenkins-hbase4.apache.org,42037,1690221975401 in 174 msec 2023-07-24 18:07:00,597 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,597 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,597 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, ASSIGN in 336 msec 2023-07-24 18:07:00,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bf590daeb93b61b9d191b2f1b657ebae, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222020597"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222020597"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222020597"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222020597"}]},"ts":"1690222020597"} 2023-07-24 18:07:00,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 18:07:00,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure bf590daeb93b61b9d191b2f1b657ebae, server=jenkins-hbase4.apache.org,34839,1690221975292 in 181 msec 2023-07-24 18:07:00,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-24 18:07:00,607 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, ASSIGN in 342 msec 2023-07-24 18:07:00,610 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:07:00,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222020611"}]},"ts":"1690222020611"} 2023-07-24 18:07:00,612 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 18:07:00,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:07:00,615 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 18:07:00,617 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 18:07:00,618 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,618 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,618 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,618 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:00,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:00,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:00,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:00,620 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:00,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 416 msec 2023-07-24 18:07:00,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 18:07:00,812 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 18:07:00,815 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 18:07:00,815 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,817 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:07:00,829 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 18:07:00,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222020829 (current time:1690222020829). 2023-07-24 18:07:00,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:00,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x09bf0cb5 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:00,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c39a503, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:00,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:00,840 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:00,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09bf0cb5 to 127.0.0.1:57118 2023-07-24 18:07:00,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:00,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x14efedab to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:00,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65448127, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:00,849 DEBUG [hconnection-0x44743131-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:00,851 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:00,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14efedab to 127.0.0.1:57118 2023-07-24 18:07:00,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:00,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 18:07:00,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:00,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 18:07:00,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 18:07:00,859 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 18:07:00,860 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690222620860 2023-07-24 18:07:00,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 18:07:00,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 18:07:00,861 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:00,861 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:00,862 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 18:07:00,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 18:07:00,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 4 msec 2023-07-24 18:07:00,864 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 18:07:00,865 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690222620865 2023-07-24 18:07:00,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,876 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 18:07:00,876 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:00,878 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 18:07:00,878 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 18:07:00,878 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,878 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,881 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:00,881 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:00,881 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:00,881 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:00,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,881 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,881 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,882 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,882 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 18:07:00,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 18:07:00,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 18:07:00,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,883 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 18:07:00,883 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 18:07:00,883 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,883 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:00,883 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 18:07:00,883 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:00,884 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 18:07:00,885 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 18:07:00,885 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 18:07:00,886 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 18:07:00,884 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,886 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 18:07:00,886 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 18:07:00,886 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:00,886 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 18:07:00,889 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 18:07:00,889 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 18:07:00,889 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,891 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:00,891 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:00,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,891 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2874ef[Count = 1] remaining members to acquire global barrier 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:00,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 18:07:00,896 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2874ef[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:00,896 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 18:07:00,896 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 18:07:00,897 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 18:07:00,897 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 18:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:00,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 18:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:00,898 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,898 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:00,898 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,898 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,898 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. started... 2023-07-24 18:07:00,898 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. started... 2023-07-24 18:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:00,898 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:00,899 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ed09e2c562042e0cd269e36b5e2b8a4: 2023-07-24 18:07:00,899 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf590daeb93b61b9d191b2f1b657ebae: 2023-07-24 18:07:00,900 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,900 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,900 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:00,900 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:00,900 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:07:00,900 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:07:00,905 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 18:07:00,905 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:00,905 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 18:07:00,912 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. completed. 2023-07-24 18:07:00,913 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:00,913 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:00,913 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:00,913 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,913 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 18:07:00,913 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:00,914 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. completed. 2023-07-24 18:07:00,914 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:00,915 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 18:07:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:00,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:00,915 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:00,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:00,918 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,918 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 18:07:00,918 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:00,918 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 18:07:00,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:00,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:00,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:07:00,925 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 18:07:00,925 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 18:07:00,925 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:00,925 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:00,925 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,925 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:00,926 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,926 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,926 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:00,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,926 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:00,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,926 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,926 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,927 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:00,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,927 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:00,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:00,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:00,928 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:00,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,928 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,930 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:00,930 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,930 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:00,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:00,934 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:00,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:00,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:00,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:00,934 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,934 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:00,936 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 18:07:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:00,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:00,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:07:00,936 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:00,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:00,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:00,936 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,937 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:00,937 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,937 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:00,937 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:00,937 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,937 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 18:07:00,949 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,962 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:00,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 18:07:00,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:00,963 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:00,970 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 18:07:00,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,989 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:00,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690222020860Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690222020949 (+89 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690222020949Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690222020949Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690222020953 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690222020964 (+11 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690222020989 (+25 ms) 2023-07-24 18:07:00,994 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 18:07:00,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 133 msec 2023-07-24 18:07:01,163 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:01,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 18:07:01,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:01,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42037] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:07:01,169 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:07:01,172 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 18:07:01,173 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:01,173 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:07:01,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 18:07:01,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222021184 (current time:1690222021184). 2023-07-24 18:07:01,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:01,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x1fcfca37 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:01,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4148dbc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:01,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:01,202 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38866, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:01,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fcfca37 to 127.0.0.1:57118 2023-07-24 18:07:01,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:01,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x00bb0725 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:01,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8a18fbd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:01,212 DEBUG [hconnection-0x412d0166-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:01,214 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38874, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:01,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00bb0725 to 127.0.0.1:57118 2023-07-24 18:07:01,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:01,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 18:07:01,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:01,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 18:07:01,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 18:07:01,224 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 18:07:01,224 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690222621224 2023-07-24 18:07:01,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 18:07:01,224 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 18:07:01,226 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:01,226 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:01,227 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 18:07:01,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 18:07:01,228 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-24 18:07:01,229 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 18:07:01,230 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690222621230 2023-07-24 18:07:01,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 18:07:01,244 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 18:07:01,245 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:01,246 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 18:07:01,246 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 18:07:01,247 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,247 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,248 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,248 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:01,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:01,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:01,248 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:01,248 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:01,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:01,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,249 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,249 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,249 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,250 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 18:07:01,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 18:07:01,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 18:07:01,250 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 18:07:01,250 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:01,251 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 18:07:01,252 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 18:07:01,252 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 18:07:01,252 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 18:07:01,252 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 18:07:01,252 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:01,252 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 18:07:01,253 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:01,253 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,255 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:01,256 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,256 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:01,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:01,257 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,257 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,258 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:01,257 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,259 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,259 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48821187[Count = 1] remaining members to acquire global barrier 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:01,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:01,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 18:07:01,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48821187[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:01,262 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 18:07:01,262 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 18:07:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,263 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 18:07:01,263 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 18:07:01,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,264 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:01,264 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,264 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:01,264 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 18:07:01,264 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:01,264 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:01,264 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. started... 2023-07-24 18:07:01,264 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:01,264 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bf590daeb93b61b9d191b2f1b657ebae 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 18:07:01,265 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 18:07:01,265 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:01,265 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 18:07:01,268 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:01,268 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:01,268 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:01,268 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. started... 2023-07-24 18:07:01,268 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ed09e2c562042e0cd269e36b5e2b8a4 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 18:07:01,294 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724dc051dcb2ce54ba29c72dd9f1743af06 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724dc051dcb2ce54ba29c72dd9f1743af06 2023-07-24 18:07:01,297 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072444a9c5589e544482b32ad605d7f61e21 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072444a9c5589e544482b32ad605d7f61e21 2023-07-24 18:07:01,311 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/.tmp/cf/7d96d590714948d1b6f16ff8dbceb8c7 2023-07-24 18:07:01,316 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/.tmp/cf/b8a4455ebac549f2b90dfc0908baa271 2023-07-24 18:07:01,323 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/.tmp/cf/7d96d590714948d1b6f16ff8dbceb8c7 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf/7d96d590714948d1b6f16ff8dbceb8c7 2023-07-24 18:07:01,326 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:01,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 18:07:01,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:01,328 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:01,329 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/.tmp/cf/b8a4455ebac549f2b90dfc0908baa271 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf/b8a4455ebac549f2b90dfc0908baa271 2023-07-24 18:07:01,329 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf/7d96d590714948d1b6f16ff8dbceb8c7, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 18:07:01,330 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 7ed09e2c562042e0cd269e36b5e2b8a4 in 62ms, sequenceid=6, compaction requested=false 2023-07-24 18:07:01,330 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 18:07:01,331 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ed09e2c562042e0cd269e36b5e2b8a4: 2023-07-24 18:07:01,331 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 18:07:01,331 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:01,331 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf/7d96d590714948d1b6f16ff8dbceb8c7] hfiles 2023-07-24 18:07:01,331 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf/7d96d590714948d1b6f16ff8dbceb8c7 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 18:07:01,344 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf/b8a4455ebac549f2b90dfc0908baa271, entries=48, sequenceid=6, filesize=12.9 K 2023-07-24 18:07:01,346 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for bf590daeb93b61b9d191b2f1b657ebae in 82ms, sequenceid=6, compaction requested=false 2023-07-24 18:07:01,348 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bf590daeb93b61b9d191b2f1b657ebae: 2023-07-24 18:07:01,348 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 18:07:01,348 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:01,348 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf/b8a4455ebac549f2b90dfc0908baa271] hfiles 2023-07-24 18:07:01,348 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf/b8a4455ebac549f2b90dfc0908baa271 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 18:07:01,370 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. completed. 2023-07-24 18:07:01,370 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:01,370 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 18:07:01,371 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:01,373 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 18:07:01,373 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,373 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:01,373 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 18:07:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:01,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:01,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:07:01,379 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 18:07:01,528 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:01,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 18:07:01,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:01,530 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:07:01,755 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. completed. 2023-07-24 18:07:01,755 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 18:07:01,755 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:01,758 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,758 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 18:07:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:01,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:01,759 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:01,759 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 18:07:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:01,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:07:01,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 18:07:01,764 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 18:07:01,764 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:01,764 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:01,764 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 18:07:01,764 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:01,765 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,765 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,765 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,765 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,766 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:01,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,765 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:01,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,765 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:01,766 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:01,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:01,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:01,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:01,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:01,767 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,768 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:01,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,773 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:01,774 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 18:07:01,774 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:01,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:01,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:01,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:01,781 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:01,781 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 18:07:01,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:01,780 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:01,780 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 18:07:01,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:01,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:01,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:01,781 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:01,783 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:07:01,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:01,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,783 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:01,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:01,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072444a9c5589e544482b32ad605d7f61e21, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724dc051dcb2ce54ba29c72dd9f1743af06] mob files 2023-07-24 18:07:01,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072444a9c5589e544482b32ad605d7f61e21 2023-07-24 18:07:01,784 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724dc051dcb2ce54ba29c72dd9f1743af06 2023-07-24 18:07:01,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 18:07:01,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,814 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 18:07:01,830 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 18:07:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:01,831 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:07:02,238 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 18:07:02,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:02,239 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:02,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690222021225Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690222021794 (+569 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690222021794Loading Region manifests for snaptb0-testConsecutiveExports at 1690222021795 (+1 ms)Writing data manifest for snaptb0-testConsecutiveExports at 1690222021798 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690222021806 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690222022238 (+432 ms) 2023-07-24 18:07:02,241 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 18:07:02,243 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 1.0150 sec 2023-07-24 18:07:02,331 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 18:07:02,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:02,333 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333 2023-07-24 18:07:02,333 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:02,355 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:02,355 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@be11e5d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:02,355 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 18:07:02,365 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:02,379 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,380 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,380 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,380 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,381 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,381 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,382 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,453 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-6149749720436041475.jar 2023-07-24 18:07:02,454 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,454 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,455 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,455 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,455 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,456 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:02,456 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:07:02,457 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:07:02,457 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:07:02,457 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:07:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:07:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:07:02,458 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:07:02,459 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:07:02,459 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:07:02,460 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:07:02,460 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:02,460 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:02,461 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:02,461 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:02,461 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:02,461 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:02,462 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:03,367 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:07:03,371 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 18:07:03,374 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 18:07:04,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:04,433 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:04,436 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0002_000001 (auth:SIMPLE) 2023-07-24 18:07:05,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0003_000001 (auth:SIMPLE) 2023-07-24 18:07:05,494 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:07:09,771 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0003_000001 (auth:SIMPLE) 2023-07-24 18:07:11,990 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0003_000001 (auth:SIMPLE) 2023-07-24 18:07:14,824 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0003_000001 (auth:SIMPLE) 2023-07-24 18:07:16,596 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:07:16,597 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:07:16,601 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 18:07:16,601 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:07:16,602 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:07:16,602 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 18:07:16,604 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 18:07:16,604 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 18:07:16,604 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@59870bf1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 18:07:16,605 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 18:07:16,605 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 18:07:16,606 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:16,627 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:16,627 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4adaa576, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:16,628 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 18:07:16,640 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 18:07:16,652 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,653 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,653 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,653 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,654 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,654 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,654 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,722 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-1922679837629249192.jar 2023-07-24 18:07:16,722 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,723 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,723 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,723 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,724 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,724 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:16,724 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:07:16,725 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:07:16,725 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:07:16,725 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:07:16,726 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:07:16,726 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:07:16,726 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:07:16,727 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:07:16,727 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:07:16,727 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:07:16,728 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:16,728 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:16,729 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:16,729 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:16,729 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:16,729 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:16,730 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:17,554 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:07:17,557 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 18:07:17,559 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 18:07:21,005 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:21,005 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:21,008 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0003_000001 (auth:SIMPLE) 2023-07-24 18:07:21,449 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0004_000001 (auth:SIMPLE) 2023-07-24 18:07:25,691 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0004_000001 (auth:SIMPLE) 2023-07-24 18:07:27,934 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0004_000001 (auth:SIMPLE) 2023-07-24 18:07:31,401 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0004_000001 (auth:SIMPLE) 2023-07-24 18:07:32,775 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:07:32,776 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:07:32,780 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 18:07:32,780 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:07:32,780 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:07:32,781 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 18:07:32,785 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 18:07:32,785 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 18:07:32,785 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@59870bf1 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 18:07:32,786 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 18:07:32,786 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/local-export-1690222022333/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 18:07:32,804 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 18:07:32,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 18:07:32,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:32,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 18:07:32,810 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222052810"}]},"ts":"1690222052810"} 2023-07-24 18:07:32,812 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 18:07:32,815 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 18:07:32,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, UNASSIGN}] 2023-07-24 18:07:32,819 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, UNASSIGN 2023-07-24 18:07:32,819 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, UNASSIGN 2023-07-24 18:07:32,820 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7ed09e2c562042e0cd269e36b5e2b8a4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:32,820 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bf590daeb93b61b9d191b2f1b657ebae, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:32,820 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222052820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222052820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222052820"}]},"ts":"1690222052820"} 2023-07-24 18:07:32,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222052820"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222052820"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222052820"}]},"ts":"1690222052820"} 2023-07-24 18:07:32,823 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 7ed09e2c562042e0cd269e36b5e2b8a4, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:07:32,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure bf590daeb93b61b9d191b2f1b657ebae, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:07:32,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 18:07:32,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bf590daeb93b61b9d191b2f1b657ebae, disabling compactions & flushes 2023-07-24 18:07:32,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:32,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ed09e2c562042e0cd269e36b5e2b8a4, disabling compactions & flushes 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. after waiting 0 ms 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:32,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. after waiting 0 ms 2023-07-24 18:07:32,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:32,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:07:32,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:07:32,993 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:32,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:32,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae. 2023-07-24 18:07:32,994 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bf590daeb93b61b9d191b2f1b657ebae: 2023-07-24 18:07:32,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4. 2023-07-24 18:07:32,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ed09e2c562042e0cd269e36b5e2b8a4: 2023-07-24 18:07:33,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:33,005 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7ed09e2c562042e0cd269e36b5e2b8a4, regionState=CLOSED 2023-07-24 18:07:33,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:33,006 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222053005"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222053005"}]},"ts":"1690222053005"} 2023-07-24 18:07:33,006 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bf590daeb93b61b9d191b2f1b657ebae, regionState=CLOSED 2023-07-24 18:07:33,006 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690222053006"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222053006"}]},"ts":"1690222053006"} 2023-07-24 18:07:33,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 18:07:33,014 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 7ed09e2c562042e0cd269e36b5e2b8a4, server=jenkins-hbase4.apache.org,42037,1690221975401 in 188 msec 2023-07-24 18:07:33,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 18:07:33,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure bf590daeb93b61b9d191b2f1b657ebae, server=jenkins-hbase4.apache.org,34839,1690221975292 in 188 msec 2023-07-24 18:07:33,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ed09e2c562042e0cd269e36b5e2b8a4, UNASSIGN in 198 msec 2023-07-24 18:07:33,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 18:07:33,018 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bf590daeb93b61b9d191b2f1b657ebae, UNASSIGN in 199 msec 2023-07-24 18:07:33,019 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222053018"}]},"ts":"1690222053018"} 2023-07-24 18:07:33,020 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 18:07:33,022 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 18:07:33,033 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 226 msec 2023-07-24 18:07:33,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 18:07:33,113 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 18:07:33,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 18:07:33,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:33,118 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:33,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 18:07:33,119 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:33,121 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 18:07:33,124 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,124 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,124 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,124 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,125 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 18:07:33,126 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 18:07:33,126 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:33,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 18:07:33,127 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 18:07:33,128 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,128 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,128 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,128 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,128 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,128 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,129 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 18:07:33,129 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 18:07:33,130 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:33,136 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/recovered.edits] 2023-07-24 18:07:33,136 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/recovered.edits] 2023-07-24 18:07:33,141 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf/7d96d590714948d1b6f16ff8dbceb8c7 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/cf/7d96d590714948d1b6f16ff8dbceb8c7 2023-07-24 18:07:33,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf/b8a4455ebac549f2b90dfc0908baa271 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/cf/b8a4455ebac549f2b90dfc0908baa271 2023-07-24 18:07:33,147 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4/recovered.edits/9.seqid 2023-07-24 18:07:33,148 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/7ed09e2c562042e0cd269e36b5e2b8a4 2023-07-24 18:07:33,150 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae/recovered.edits/9.seqid 2023-07-24 18:07:33,151 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testConsecutiveExports/bf590daeb93b61b9d191b2f1b657ebae 2023-07-24 18:07:33,151 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 18:07:33,151 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 18:07:33,152 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 18:07:33,156 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072444a9c5589e544482b32ad605d7f61e21 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072444a9c5589e544482b32ad605d7f61e21 2023-07-24 18:07:33,157 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724dc051dcb2ce54ba29c72dd9f1743af06 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724dc051dcb2ce54ba29c72dd9f1743af06 2023-07-24 18:07:33,158 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 18:07:33,161 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:33,164 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 18:07:33,166 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 18:07:33,168 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:33,168 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 18:07:33,168 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222053168"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:33,168 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222053168"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:33,171 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 18:07:33,171 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ed09e2c562042e0cd269e36b5e2b8a4, NAME => 'testtb-testConsecutiveExports,,1690222020203.7ed09e2c562042e0cd269e36b5e2b8a4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bf590daeb93b61b9d191b2f1b657ebae, NAME => 'testtb-testConsecutiveExports,1,1690222020203.bf590daeb93b61b9d191b2f1b657ebae.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 18:07:33,171 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 18:07:33,171 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222053171"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:33,173 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 18:07:33,175 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 18:07:33,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 61 msec 2023-07-24 18:07:33,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 18:07:33,232 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 18:07:33,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 18:07:33,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 18:07:33,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 18:07:33,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 18:07:33,277 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=741 (was 761), OpenFileDescriptor=902 (was 928), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=536 (was 405) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5812 (was 5508) - AvailableMemoryMB LEAK? - 2023-07-24 18:07:33,277 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=741 is superior to 500 2023-07-24 18:07:33,315 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=741, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=536, ProcessCount=181, AvailableMemoryMB=5805 2023-07-24 18:07:33,316 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=741 is superior to 500 2023-07-24 18:07:33,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 18:07:33,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:33,323 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:07:33,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 18:07:33,324 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:07:33,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 18:07:33,327 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,327 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,328 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d empty. 2023-07-24 18:07:33,328 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 empty. 2023-07-24 18:07:33,331 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,333 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,333 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 18:07:33,359 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 18:07:33,360 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => cd4d4c515b9fd374657ed92b4ec16b7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:33,362 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => a45d107fd53653d793e6f6bb24dba009, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:33,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:33,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing cd4d4c515b9fd374657ed92b4ec16b7d, disabling compactions & flushes 2023-07-24 18:07:33,383 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,383 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. after waiting 0 ms 2023-07-24 18:07:33,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,384 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,384 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for cd4d4c515b9fd374657ed92b4ec16b7d: 2023-07-24 18:07:33,401 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:33,401 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing a45d107fd53653d793e6f6bb24dba009, disabling compactions & flushes 2023-07-24 18:07:33,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,401 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,401 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. after waiting 0 ms 2023-07-24 18:07:33,401 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,401 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,401 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for a45d107fd53653d793e6f6bb24dba009: 2023-07-24 18:07:33,406 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:07:33,407 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222053406"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222053406"}]},"ts":"1690222053406"} 2023-07-24 18:07:33,407 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222053406"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222053406"}]},"ts":"1690222053406"} 2023-07-24 18:07:33,415 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:07:33,416 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:07:33,416 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222053416"}]},"ts":"1690222053416"} 2023-07-24 18:07:33,418 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 18:07:33,421 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:07:33,422 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:07:33,422 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:07:33,422 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:07:33,422 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:07:33,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, ASSIGN}] 2023-07-24 18:07:33,425 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, ASSIGN 2023-07-24 18:07:33,425 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, ASSIGN 2023-07-24 18:07:33,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 18:07:33,427 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1690221975292; forceNewPlan=false, retain=false 2023-07-24 18:07:33,428 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:07:33,577 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:07:33,582 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=cd4d4c515b9fd374657ed92b4ec16b7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:33,582 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222053581"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222053581"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222053581"}]},"ts":"1690222053581"} 2023-07-24 18:07:33,582 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a45d107fd53653d793e6f6bb24dba009, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:33,582 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222053582"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222053582"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222053582"}]},"ts":"1690222053582"} 2023-07-24 18:07:33,593 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure cd4d4c515b9fd374657ed92b4ec16b7d, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:07:33,594 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure a45d107fd53653d793e6f6bb24dba009, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:07:33,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 18:07:33,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,751 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cd4d4c515b9fd374657ed92b4ec16b7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 18:07:33,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a45d107fd53653d793e6f6bb24dba009, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 18:07:33,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. service=AccessControlService 2023-07-24 18:07:33,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. service=AccessControlService 2023-07-24 18:07:33,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:33,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,754 INFO [StoreOpener-a45d107fd53653d793e6f6bb24dba009-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,754 INFO [StoreOpener-cd4d4c515b9fd374657ed92b4ec16b7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,756 DEBUG [StoreOpener-a45d107fd53653d793e6f6bb24dba009-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf 2023-07-24 18:07:33,756 DEBUG [StoreOpener-cd4d4c515b9fd374657ed92b4ec16b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf 2023-07-24 18:07:33,756 DEBUG [StoreOpener-cd4d4c515b9fd374657ed92b4ec16b7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf 2023-07-24 18:07:33,756 DEBUG [StoreOpener-a45d107fd53653d793e6f6bb24dba009-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf 2023-07-24 18:07:33,757 INFO [StoreOpener-cd4d4c515b9fd374657ed92b4ec16b7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cd4d4c515b9fd374657ed92b4ec16b7d columnFamilyName cf 2023-07-24 18:07:33,757 INFO [StoreOpener-a45d107fd53653d793e6f6bb24dba009-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a45d107fd53653d793e6f6bb24dba009 columnFamilyName cf 2023-07-24 18:07:33,760 INFO [StoreOpener-cd4d4c515b9fd374657ed92b4ec16b7d-1] regionserver.HStore(310): Store=cd4d4c515b9fd374657ed92b4ec16b7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:33,760 INFO [StoreOpener-a45d107fd53653d793e6f6bb24dba009-1] regionserver.HStore(310): Store=a45d107fd53653d793e6f6bb24dba009/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:33,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,761 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:33,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:33,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:33,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cd4d4c515b9fd374657ed92b4ec16b7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73840400, jitterRate=0.10030770301818848}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:33,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:33,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cd4d4c515b9fd374657ed92b4ec16b7d: 2023-07-24 18:07:33,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d., pid=60, masterSystemTime=1690222053747 2023-07-24 18:07:33,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a45d107fd53653d793e6f6bb24dba009; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66561813, jitterRate=-0.008151695132255554}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:33,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a45d107fd53653d793e6f6bb24dba009: 2023-07-24 18:07:33,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009., pid=61, masterSystemTime=1690222053748 2023-07-24 18:07:33,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,773 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,774 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=cd4d4c515b9fd374657ed92b4ec16b7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:33,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:33,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222053774"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222053774"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222053774"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222053774"}]},"ts":"1690222053774"} 2023-07-24 18:07:33,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=a45d107fd53653d793e6f6bb24dba009, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:33,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222053775"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222053775"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222053775"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222053775"}]},"ts":"1690222053775"} 2023-07-24 18:07:33,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 18:07:33,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure cd4d4c515b9fd374657ed92b4ec16b7d, server=jenkins-hbase4.apache.org,42037,1690221975401 in 183 msec 2023-07-24 18:07:33,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 18:07:33,780 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, ASSIGN in 357 msec 2023-07-24 18:07:33,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure a45d107fd53653d793e6f6bb24dba009, server=jenkins-hbase4.apache.org,34839,1690221975292 in 184 msec 2023-07-24 18:07:33,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 18:07:33,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, ASSIGN in 358 msec 2023-07-24 18:07:33,783 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:07:33,783 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222053783"}]},"ts":"1690222053783"} 2023-07-24 18:07:33,788 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 18:07:33,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:07:33,792 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 18:07:33,794 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 18:07:33,795 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,796 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,796 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,796 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:33,798 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:33,798 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:33,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:33,798 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:33,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:33,798 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:33,799 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:33,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 480 msec 2023-07-24 18:07:33,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 18:07:33,930 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 18:07:33,933 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:33,933 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:33,935 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:07:33,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 18:07:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222053952 (current time:1690222053952). 2023-07-24 18:07:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:33,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x2cfa9ce5 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:33,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f5dc62b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:33,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:33,966 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cfa9ce5 to 127.0.0.1:57118 2023-07-24 18:07:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:33,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x0a6d8caf to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:33,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@720834b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:33,975 DEBUG [hconnection-0x2335d847-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:33,979 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:33,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a6d8caf to 127.0.0.1:57118 2023-07-24 18:07:33,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:33,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 18:07:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:33,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 18:07:33,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 18:07:33,989 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 18:07:33,990 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690222653990 2023-07-24 18:07:33,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 18:07:33,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:33,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 18:07:33,993 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 18:07:33,993 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:33,993 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:33,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-24 18:07:33,995 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 18:07:33,996 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690222653996 2023-07-24 18:07:34,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,017 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 18:07:34,017 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,019 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 18:07:34,019 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 18:07:34,020 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,020 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,021 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,021 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,021 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,021 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,022 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,022 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,022 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,023 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,023 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 18:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,023 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 18:07:34,023 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,024 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,025 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 18:07:34,025 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 18:07:34,025 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,025 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 18:07:34,026 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 18:07:34,026 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 18:07:34,026 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 18:07:34,026 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 18:07:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 18:07:34,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 18:07:34,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,031 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 18:07:34,031 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 18:07:34,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 18:07:34,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 18:07:34,034 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,034 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,034 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,034 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,034 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:34,035 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,035 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,035 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,036 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,036 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,036 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:34,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 18:07:34,038 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d279c1e[Count = 1] remaining members to acquire global barrier 2023-07-24 18:07:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 18:07:34,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d279c1e[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:34,040 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 18:07:34,040 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,044 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,044 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 18:07:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:34,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 18:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 18:07:34,045 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:34,045 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,046 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:34,045 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. started... 2023-07-24 18:07:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 18:07:34,046 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:34,046 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a45d107fd53653d793e6f6bb24dba009: 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. started... 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cd4d4c515b9fd374657ed92b4ec16b7d: 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:07:34,058 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 18:07:34,058 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:34,058 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 18:07:34,086 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. completed. 2023-07-24 18:07:34,086 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:34,086 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:34,086 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:34,087 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,087 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 18:07:34,087 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:34,089 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 18:07:34,089 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,089 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,089 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 18:07:34,091 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. completed. 2023-07-24 18:07:34,091 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 18:07:34,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,093 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:34,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 18:07:34,093 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:34,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 18:07:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 18:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:34,096 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 18:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:07:34,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 18:07:34,103 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 18:07:34,103 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:34,103 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:34,103 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,103 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:34,105 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,105 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,105 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:34,105 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,105 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:34,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:34,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,106 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:34,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,107 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:34,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,108 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,111 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,111 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,111 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,115 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:34,115 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,115 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:34,116 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,116 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,116 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,116 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,116 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:07:34,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:34,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:34,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:34,115 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:34,116 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,119 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,119 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,119 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,119 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,119 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 18:07:34,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:34,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:34,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,274 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 18:07:34,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,274 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690222053990Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690222054159 (+169 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690222054159Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690222054159Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690222054172 (+13 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690222054218 (+46 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690222054274 (+56 ms) 2023-07-24 18:07:34,278 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 18:07:34,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 287 msec 2023-07-24 18:07:34,296 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 18:07:34,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:34,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42037] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:07:34,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:07:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,310 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:34,310 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:07:34,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 18:07:34,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222054327 (current time:1690222054327). 2023-07-24 18:07:34,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:34,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x0988d383 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:34,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4963442c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:34,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:34,350 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33016, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0988d383 to 127.0.0.1:57118 2023-07-24 18:07:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:34,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x0a01f87d to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:34,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45da2675, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:34,366 DEBUG [hconnection-0x16cb58c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:34,371 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33030, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:34,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a01f87d to 127.0.0.1:57118 2023-07-24 18:07:34,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:34,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 18:07:34,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:34,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 18:07:34,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 18:07:34,387 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 18:07:34,387 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690222654387 2023-07-24 18:07:34,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 18:07:34,389 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:34,389 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:34,390 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 18:07:34,391 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 18:07:34,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-24 18:07:34,394 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 18:07:34,395 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690222654395 2023-07-24 18:07:34,419 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,419 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 18:07:34,419 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,421 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 18:07:34,421 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 18:07:34,423 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,423 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,424 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,424 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,424 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,424 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:34,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:34,425 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,425 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,426 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,426 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 18:07:34,426 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 18:07:34,427 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 18:07:34,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,428 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 18:07:34,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,428 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 18:07:34,428 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,430 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 18:07:34,430 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,432 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 18:07:34,432 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 18:07:34,432 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,432 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:34,432 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 18:07:34,434 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 18:07:34,436 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,436 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,436 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,436 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,436 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,436 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,436 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:34,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,437 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,437 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:34,437 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,437 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5145355[Count = 1] remaining members to acquire global barrier 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 18:07:34,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5145355[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:34,441 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 18:07:34,441 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,442 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,442 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 18:07:34,443 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:34,443 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:34,443 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:34,443 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. started... 2023-07-24 18:07:34,443 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. started... 2023-07-24 18:07:34,443 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,443 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:34,444 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a45d107fd53653d793e6f6bb24dba009 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 18:07:34,443 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:34,444 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:34,443 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing cd4d4c515b9fd374657ed92b4ec16b7d 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 18:07:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 18:07:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:34,446 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 18:07:34,489 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:34,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 18:07:34,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:34,491 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:34,556 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724e8aaca1025a749898dbe2b8fa459a509 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e8aaca1025a749898dbe2b8fa459a509 2023-07-24 18:07:34,584 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/.tmp/cf/c6a362dd12734bf5bc2971bd66743de6 2023-07-24 18:07:34,591 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/.tmp/cf/c6a362dd12734bf5bc2971bd66743de6 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf/c6a362dd12734bf5bc2971bd66743de6 2023-07-24 18:07:34,597 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf/c6a362dd12734bf5bc2971bd66743de6, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 18:07:34,598 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for cd4d4c515b9fd374657ed92b4ec16b7d in 155ms, sequenceid=6, compaction requested=false 2023-07-24 18:07:34,598 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 18:07:34,598 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for cd4d4c515b9fd374657ed92b4ec16b7d: 2023-07-24 18:07:34,599 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,599 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:34,599 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf/c6a362dd12734bf5bc2971bd66743de6] hfiles 2023-07-24 18:07:34,599 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf/c6a362dd12734bf5bc2971bd66743de6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,610 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. completed. 2023-07-24 18:07:34,610 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 18:07:34,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:34,612 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,612 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 18:07:34,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:34,612 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:34,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:34,613 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 18:07:34,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:34,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:34,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:34,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:34,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:07:34,618 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 18:07:34,692 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:34,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 18:07:34,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:34,693 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:07:34,953 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307242a0914115b69440988a883e1f45cab2a to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307242a0914115b69440988a883e1f45cab2a 2023-07-24 18:07:34,967 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/.tmp/cf/8fb8bfd58f2c44d7833108f05328a34a 2023-07-24 18:07:34,973 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/.tmp/cf/8fb8bfd58f2c44d7833108f05328a34a as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf/8fb8bfd58f2c44d7833108f05328a34a 2023-07-24 18:07:34,985 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf/8fb8bfd58f2c44d7833108f05328a34a, entries=46, sequenceid=6, filesize=13.4 K 2023-07-24 18:07:34,986 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for a45d107fd53653d793e6f6bb24dba009 in 543ms, sequenceid=6, compaction requested=false 2023-07-24 18:07:34,988 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a45d107fd53653d793e6f6bb24dba009: 2023-07-24 18:07:34,988 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,988 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:34,989 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf/8fb8bfd58f2c44d7833108f05328a34a] hfiles 2023-07-24 18:07:34,989 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf/8fb8bfd58f2c44d7833108f05328a34a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:34,994 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:34,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 18:07:34,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:34,995 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:07:35,008 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. completed. 2023-07-24 18:07:35,008 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:35,008 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:35,009 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:35,009 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,009 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 18:07:35,009 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:35,010 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,010 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 18:07:35,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:35,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:35,010 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:35,011 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 18:07:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:35,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:07:35,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 18:07:35,020 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 18:07:35,020 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:35,020 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:35,020 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,020 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:35,024 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:35,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:35,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:35,025 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:35,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:35,025 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:35,027 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:35,032 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,032 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,033 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,036 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:35,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:35,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:35,037 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:35,039 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:35,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:35,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:35,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,039 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,039 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:35,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:35,039 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:35,039 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:35,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:07:35,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:35,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:35,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,040 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:35,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:35,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307242a0914115b69440988a883e1f45cab2a, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e8aaca1025a749898dbe2b8fa459a509] mob files 2023-07-24 18:07:35,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307242a0914115b69440988a883e1f45cab2a 2023-07-24 18:07:35,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e8aaca1025a749898dbe2b8fa459a509 2023-07-24 18:07:35,055 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,056 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,108 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 18:07:35,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,162 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:35,162 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690222054388Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690222055055 (+667 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690222055055Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690222055055Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690222055066 (+11 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690222055100 (+34 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690222055162 (+62 ms) 2023-07-24 18:07:35,166 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 18:07:35,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 777 msec 2023-07-24 18:07:35,496 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:35,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 18:07:35,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:35,551 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 18:07:35,560 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 18:07:35,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 18:07:35,564 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 18:07:35,582 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 18:07:35,583 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37319] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 18:07:35,584 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 18:07:35,588 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 18:07:35,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42037] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 18:07:35,592 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 18:07:35,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:35,600 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:07:35,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 18:07:35,603 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:07:35,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 18:07:35,611 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:35,614 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c empty. 2023-07-24 18:07:35,615 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:35,615 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:35,615 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b empty. 2023-07-24 18:07:35,616 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:35,616 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 18:07:35,647 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 18:07:35,649 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6b33482b7c96d9d6096e3f802b9bf96b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:35,649 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a063bbb153d6f2140ab77b370145119c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:35,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:35,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 6b33482b7c96d9d6096e3f802b9bf96b, disabling compactions & flushes 2023-07-24 18:07:35,697 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:35,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:35,697 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. after waiting 0 ms 2023-07-24 18:07:35,698 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:35,698 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:35,698 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 6b33482b7c96d9d6096e3f802b9bf96b: 2023-07-24 18:07:35,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 18:07:35,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:35,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing a063bbb153d6f2140ab77b370145119c, disabling compactions & flushes 2023-07-24 18:07:35,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:35,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:35,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. after waiting 0 ms 2023-07-24 18:07:35,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:35,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:35,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for a063bbb153d6f2140ab77b370145119c: 2023-07-24 18:07:35,714 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:07:35,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222055715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222055715"}]},"ts":"1690222055715"} 2023-07-24 18:07:35,715 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222055715"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222055715"}]},"ts":"1690222055715"} 2023-07-24 18:07:35,718 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:07:35,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:07:35,719 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222055719"}]},"ts":"1690222055719"} 2023-07-24 18:07:35,721 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 18:07:35,725 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:07:35,730 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:07:35,730 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:07:35,730 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:07:35,730 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:07:35,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, ASSIGN}] 2023-07-24 18:07:35,738 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, ASSIGN 2023-07-24 18:07:35,738 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, ASSIGN 2023-07-24 18:07:35,740 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1690221975292; forceNewPlan=false, retain=false 2023-07-24 18:07:35,740 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37319,1690221975353; forceNewPlan=false, retain=false 2023-07-24 18:07:35,891 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:07:35,894 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6b33482b7c96d9d6096e3f802b9bf96b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:35,894 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a063bbb153d6f2140ab77b370145119c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:35,895 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222055894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222055894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222055894"}]},"ts":"1690222055894"} 2023-07-24 18:07:35,895 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222055894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222055894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222055894"}]},"ts":"1690222055894"} 2023-07-24 18:07:35,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 18:07:35,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 6b33482b7c96d9d6096e3f802b9bf96b, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:07:35,911 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure a063bbb153d6f2140ab77b370145119c, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:07:36,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6b33482b7c96d9d6096e3f802b9bf96b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 18:07:36,070 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:36,070 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 18:07:36,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. service=AccessControlService 2023-07-24 18:07:36,071 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:36,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:36,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,080 INFO [StoreOpener-6b33482b7c96d9d6096e3f802b9bf96b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,083 DEBUG [StoreOpener-6b33482b7c96d9d6096e3f802b9bf96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf 2023-07-24 18:07:36,089 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 18:07:36,092 DEBUG [StoreOpener-6b33482b7c96d9d6096e3f802b9bf96b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf 2023-07-24 18:07:36,093 INFO [StoreOpener-6b33482b7c96d9d6096e3f802b9bf96b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6b33482b7c96d9d6096e3f802b9bf96b columnFamilyName cf 2023-07-24 18:07:36,097 INFO [StoreOpener-6b33482b7c96d9d6096e3f802b9bf96b-1] regionserver.HStore(310): Store=6b33482b7c96d9d6096e3f802b9bf96b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:36,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a063bbb153d6f2140ab77b370145119c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 18:07:36,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. service=AccessControlService 2023-07-24 18:07:36,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:36,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:36,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:36,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6b33482b7c96d9d6096e3f802b9bf96b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64505749, jitterRate=-0.03878943622112274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:36,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6b33482b7c96d9d6096e3f802b9bf96b: 2023-07-24 18:07:36,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b., pid=69, masterSystemTime=1690222056064 2023-07-24 18:07:36,118 INFO [StoreOpener-a063bbb153d6f2140ab77b370145119c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,119 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,121 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=6b33482b7c96d9d6096e3f802b9bf96b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:36,121 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222056121"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222056121"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222056121"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222056121"}]},"ts":"1690222056121"} 2023-07-24 18:07:36,122 DEBUG [StoreOpener-a063bbb153d6f2140ab77b370145119c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf 2023-07-24 18:07:36,122 DEBUG [StoreOpener-a063bbb153d6f2140ab77b370145119c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf 2023-07-24 18:07:36,123 INFO [StoreOpener-a063bbb153d6f2140ab77b370145119c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a063bbb153d6f2140ab77b370145119c columnFamilyName cf 2023-07-24 18:07:36,124 INFO [StoreOpener-a063bbb153d6f2140ab77b370145119c-1] regionserver.HStore(310): Store=a063bbb153d6f2140ab77b370145119c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:36,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,125 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 18:07:36,127 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 6b33482b7c96d9d6096e3f802b9bf96b, server=jenkins-hbase4.apache.org,34839,1690221975292 in 217 msec 2023-07-24 18:07:36,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, ASSIGN in 396 msec 2023-07-24 18:07:36,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:36,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a063bbb153d6f2140ab77b370145119c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75475607, jitterRate=0.12467418611049652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:36,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a063bbb153d6f2140ab77b370145119c: 2023-07-24 18:07:36,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c., pid=70, masterSystemTime=1690222056070 2023-07-24 18:07:36,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,145 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=a063bbb153d6f2140ab77b370145119c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:36,145 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222056145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222056145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222056145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222056145"}]},"ts":"1690222056145"} 2023-07-24 18:07:36,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 18:07:36,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure a063bbb153d6f2140ab77b370145119c, server=jenkins-hbase4.apache.org,37319,1690221975353 in 236 msec 2023-07-24 18:07:36,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 18:07:36,153 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, ASSIGN in 420 msec 2023-07-24 18:07:36,154 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:07:36,154 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222056154"}]},"ts":"1690222056154"} 2023-07-24 18:07:36,155 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 18:07:36,158 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:07:36,158 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 18:07:36,160 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 18:07:36,162 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:36,162 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:36,162 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:36,162 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:36,165 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,165 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,166 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,167 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,170 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:36,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 573 msec 2023-07-24 18:07:36,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 18:07:36,208 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 18:07:36,213 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:36,231 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59932, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:36,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions a063bbb153d6f2140ab77b370145119c, 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a063bbb153d6f2140ab77b370145119c, 6b33482b7c96d9d6096e3f802b9bf96b], force=true 2023-07-24 18:07:36,269 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a063bbb153d6f2140ab77b370145119c, 6b33482b7c96d9d6096e3f802b9bf96b], force=true 2023-07-24 18:07:36,269 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a063bbb153d6f2140ab77b370145119c, 6b33482b7c96d9d6096e3f802b9bf96b], force=true 2023-07-24 18:07:36,269 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a063bbb153d6f2140ab77b370145119c, 6b33482b7c96d9d6096e3f802b9bf96b], force=true 2023-07-24 18:07:36,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 18:07:36,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, UNASSIGN}] 2023-07-24 18:07:36,294 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, UNASSIGN 2023-07-24 18:07:36,294 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, UNASSIGN 2023-07-24 18:07:36,295 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a063bbb153d6f2140ab77b370145119c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:36,295 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6b33482b7c96d9d6096e3f802b9bf96b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:36,295 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222056295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222056295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222056295"}]},"ts":"1690222056295"} 2023-07-24 18:07:36,295 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222056295"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222056295"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222056295"}]},"ts":"1690222056295"} 2023-07-24 18:07:36,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure a063bbb153d6f2140ab77b370145119c, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:07:36,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 6b33482b7c96d9d6096e3f802b9bf96b, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:07:36,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 18:07:36,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a063bbb153d6f2140ab77b370145119c, disabling compactions & flushes 2023-07-24 18:07:36,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. after waiting 0 ms 2023-07-24 18:07:36,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a063bbb153d6f2140ab77b370145119c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 18:07:36,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6b33482b7c96d9d6096e3f802b9bf96b, disabling compactions & flushes 2023-07-24 18:07:36,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. after waiting 0 ms 2023-07-24 18:07:36,453 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,453 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6b33482b7c96d9d6096e3f802b9bf96b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 18:07:36,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/.tmp/cf/5e899c45cbc340468f0a4a43dea8022b 2023-07-24 18:07:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/.tmp/cf/5e899c45cbc340468f0a4a43dea8022b as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf/5e899c45cbc340468f0a4a43dea8022b 2023-07-24 18:07:36,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf/5e899c45cbc340468f0a4a43dea8022b, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 18:07:36,506 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6b33482b7c96d9d6096e3f802b9bf96b in 53ms, sequenceid=5, compaction requested=false 2023-07-24 18:07:36,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 18:07:36,527 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/.tmp/cf/782e637d70c24589afb3859d2fa5ea28 2023-07-24 18:07:36,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 18:07:36,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:36,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b. 2023-07-24 18:07:36,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6b33482b7c96d9d6096e3f802b9bf96b: 2023-07-24 18:07:36,538 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:36,539 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=6b33482b7c96d9d6096e3f802b9bf96b, regionState=CLOSED 2023-07-24 18:07:36,539 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222056539"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222056539"}]},"ts":"1690222056539"} 2023-07-24 18:07:36,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/.tmp/cf/782e637d70c24589afb3859d2fa5ea28 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf/782e637d70c24589afb3859d2fa5ea28 2023-07-24 18:07:36,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 18:07:36,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 6b33482b7c96d9d6096e3f802b9bf96b, server=jenkins-hbase4.apache.org,34839,1690221975292 in 244 msec 2023-07-24 18:07:36,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6b33482b7c96d9d6096e3f802b9bf96b, UNASSIGN in 251 msec 2023-07-24 18:07:36,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf/782e637d70c24589afb3859d2fa5ea28, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 18:07:36,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a063bbb153d6f2140ab77b370145119c in 99ms, sequenceid=5, compaction requested=false 2023-07-24 18:07:36,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 18:07:36,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:36,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c. 2023-07-24 18:07:36,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a063bbb153d6f2140ab77b370145119c: 2023-07-24 18:07:36,568 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:36,568 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=a063bbb153d6f2140ab77b370145119c, regionState=CLOSED 2023-07-24 18:07:36,569 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690222056568"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222056568"}]},"ts":"1690222056568"} 2023-07-24 18:07:36,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 18:07:36,574 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure a063bbb153d6f2140ab77b370145119c, server=jenkins-hbase4.apache.org,37319,1690221975353 in 274 msec 2023-07-24 18:07:36,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 18:07:36,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 18:07:36,576 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a063bbb153d6f2140ab77b370145119c, UNASSIGN in 284 msec 2023-07-24 18:07:36,704 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 18:07:36,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055592.a063bbb153d6f2140ab77b370145119c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:36,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690222055592.6b33482b7c96d9d6096e3f802b9bf96b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:36,709 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:36,847 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, ASSIGN}] 2023-07-24 18:07:36,848 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, ASSIGN 2023-07-24 18:07:36,849 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37319,1690221975353; forceNewPlan=false, retain=false 2023-07-24 18:07:36,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 18:07:36,999 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 18:07:37,002 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4e5159f81417fdb0c731e78ab0e69bd7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,002 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690222057002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222057002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222057002"}]},"ts":"1690222057002"} 2023-07-24 18:07:37,004 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 4e5159f81417fdb0c731e78ab0e69bd7, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:07:37,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:37,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4e5159f81417fdb0c731e78ab0e69bd7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.', STARTKEY => '', ENDKEY => ''} 2023-07-24 18:07:37,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. service=AccessControlService 2023-07-24 18:07:37,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:37,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:37,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/.regioninfo 2023-07-24 18:07:37,190 INFO [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,191 DEBUG [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf 2023-07-24 18:07:37,191 DEBUG [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf 2023-07-24 18:07:37,191 INFO [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4e5159f81417fdb0c731e78ab0e69bd7 columnFamilyName cf 2023-07-24 18:07:37,221 DEBUG [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] regionserver.HStore(539): loaded hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/5e899c45cbc340468f0a4a43dea8022b.6b33482b7c96d9d6096e3f802b9bf96b->hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf/5e899c45cbc340468f0a4a43dea8022b-top 2023-07-24 18:07:37,227 DEBUG [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] regionserver.HStore(539): loaded hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/782e637d70c24589afb3859d2fa5ea28.a063bbb153d6f2140ab77b370145119c->hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf/782e637d70c24589afb3859d2fa5ea28-top 2023-07-24 18:07:37,227 INFO [StoreOpener-4e5159f81417fdb0c731e78ab0e69bd7-1] regionserver.HStore(310): Store=4e5159f81417fdb0c731e78ab0e69bd7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:37,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:37,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4e5159f81417fdb0c731e78ab0e69bd7; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73336294, jitterRate=0.09279593825340271}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:37,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4e5159f81417fdb0c731e78ab0e69bd7: 2023-07-24 18:07:37,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7., pid=77, masterSystemTime=1690222057158 2023-07-24 18:07:37,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.,because compaction is disabled. 2023-07-24 18:07:37,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:37,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:37,258 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=4e5159f81417fdb0c731e78ab0e69bd7, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,258 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690222057258"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222057258"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222057258"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222057258"}]},"ts":"1690222057258"} 2023-07-24 18:07:37,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 18:07:37,261 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 4e5159f81417fdb0c731e78ab0e69bd7, server=jenkins-hbase4.apache.org,37319,1690221975353 in 256 msec 2023-07-24 18:07:37,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 18:07:37,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, ASSIGN in 415 msec 2023-07-24 18:07:37,265 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[a063bbb153d6f2140ab77b370145119c, 6b33482b7c96d9d6096e3f802b9bf96b], force=true in 1.0030 sec 2023-07-24 18:07:37,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 18:07:37,377 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 18:07:37,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 18:07:37,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222057378 (current time:1690222057378). 2023-07-24 18:07:37,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:37,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x25a2f291 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:37,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@443c3c99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:37,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:37,454 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:37,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25a2f291 to 127.0.0.1:57118 2023-07-24 18:07:37,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:37,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x4d41ddbb to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:37,533 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0004_000001 (auth:SIMPLE) 2023-07-24 18:07:37,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f4588f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:37,583 DEBUG [hconnection-0x5ab8bb7d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:37,586 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33054, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:37,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d41ddbb to 127.0.0.1:57118 2023-07-24 18:07:37,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:37,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 18:07:37,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:37,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 18:07:37,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 18:07:37,607 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 18:07:37,607 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690222657607 2023-07-24 18:07:37,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 18:07:37,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,611 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:37,611 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:37,613 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 18:07:37,613 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 18:07:37,615 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-24 18:07:37,616 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 18:07:37,616 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690222657616 2023-07-24 18:07:37,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,630 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 18:07:37,630 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:37,631 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 18:07:37,631 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 18:07:37,657 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,658 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,696 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:37,696 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:37,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:37,696 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:37,696 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:37,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:37,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:37,696 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,697 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:37,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 18:07:37,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,698 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 18:07:37,698 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 18:07:37,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,700 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:37,700 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:37,701 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 18:07:37,702 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 18:07:37,702 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 18:07:37,703 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 18:07:37,703 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 18:07:37,702 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 18:07:37,712 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:37,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 18:07:37,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:37,713 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:37,727 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,727 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:37,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:37,758 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,758 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,759 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:37,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:37,758 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,760 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,760 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:37,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:37,760 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,760 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:37,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:37,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:37,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:37,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 18:07:37,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a64c014[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:37,762 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 18:07:37,762 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 18:07:37,858 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 18:07:37,858 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:37,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:37,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 18:07:37,858 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:37,859 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:37,859 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:37,859 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:37,859 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. started... 2023-07-24 18:07:37,860 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4e5159f81417fdb0c731e78ab0e69bd7: 2023-07-24 18:07:37,860 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,861 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:37,861 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/5e899c45cbc340468f0a4a43dea8022b.6b33482b7c96d9d6096e3f802b9bf96b->hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf/5e899c45cbc340468f0a4a43dea8022b-top, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/782e637d70c24589afb3859d2fa5ea28.a063bbb153d6f2140ab77b370145119c->hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf/782e637d70c24589afb3859d2fa5ea28-top] hfiles 2023-07-24 18:07:37,861 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/5e899c45cbc340468f0a4a43dea8022b.6b33482b7c96d9d6096e3f802b9bf96b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,861 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/782e637d70c24589afb3859d2fa5ea28.a063bbb153d6f2140ab77b370145119c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:37,873 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. completed. 2023-07-24 18:07:37,873 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 18:07:37,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 18:07:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:37,896 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 18:07:37,913 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:37,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 18:07:37,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:37,914 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:07:37,950 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 18:07:37,950 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:37,950 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 18:07:38,097 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 18:07:38,097 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,097 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:38,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:38,097 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 18:07:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:38,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37319,1690221975353': 2023-07-24 18:07:38,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 18:07:38,103 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 18:07:38,103 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:38,103 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:38,103 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,103 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:38,150 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,150 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:38,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:38,150 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,150 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,151 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:38,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:38,151 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,150 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:38,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,151 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:38,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:38,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:38,152 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:38,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,152 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:38,154 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,155 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,155 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,190 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:38,190 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:38,190 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:38,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:38,190 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:38,190 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:38,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:38,190 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,191 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:38,191 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,191 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:38,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:38,191 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,191 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:38,191 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:38,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:38,191 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,192 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:38,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:38,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:38,202 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,214 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:38,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 18:07:38,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:38,216 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:07:38,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,327 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 18:07:38,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,328 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,328 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690222057608Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690222058191 (+583 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690222058191Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690222058207 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690222058221 (+14 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690222058327 (+106 ms) 2023-07-24 18:07:38,331 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 18:07:38,332 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 720 msec 2023-07-24 18:07:38,588 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:07:38,716 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:38,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 18:07:38,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:38,718 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718 2023-07-24 18:07:38,718 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35665, tgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718, rawTgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:38,744 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:38,745 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2137538009_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,745 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 18:07:38,755 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:38,849 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,850 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,851 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,851 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,852 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,852 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,852 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,958 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-3296725167262003912.jar 2023-07-24 18:07:38,959 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,959 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,960 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,960 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,961 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,961 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:38,962 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:07:38,963 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:07:38,963 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:07:38,964 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:07:38,964 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:07:38,965 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:07:38,965 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:07:38,966 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:07:38,967 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:07:38,967 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:07:38,968 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:38,968 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:38,969 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:38,969 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:38,970 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:38,970 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:38,971 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:39,880 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:07:39,883 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 18:07:39,886 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 18:07:39,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:39,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:40,421 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0005_000001 (auth:SIMPLE) 2023-07-24 18:07:46,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0005_000001 (auth:SIMPLE) 2023-07-24 18:07:49,095 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0005_000001 (auth:SIMPLE) 2023-07-24 18:07:52,528 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0005_000001 (auth:SIMPLE) 2023-07-24 18:07:54,247 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:07:54,251 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:07:54,279 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,279 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:07:54,280 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:07:54,280 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,283 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 18:07:54,283 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 18:07:54,283 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,284 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 18:07:54,284 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222058718/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 18:07:54,298 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 18:07:54,305 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222074305"}]},"ts":"1690222074305"} 2023-07-24 18:07:54,312 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 18:07:54,314 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 18:07:54,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, UNASSIGN}] 2023-07-24 18:07:54,317 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, UNASSIGN 2023-07-24 18:07:54,319 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4e5159f81417fdb0c731e78ab0e69bd7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:54,319 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690222074318"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222074318"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222074318"}]},"ts":"1690222074318"} 2023-07-24 18:07:54,321 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 4e5159f81417fdb0c731e78ab0e69bd7, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:07:54,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 18:07:54,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4e5159f81417fdb0c731e78ab0e69bd7, disabling compactions & flushes 2023-07-24 18:07:54,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. after waiting 0 ms 2023-07-24 18:07:54,474 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:54,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 18:07:54,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:54,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7. 2023-07-24 18:07:54,512 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4e5159f81417fdb0c731e78ab0e69bd7: 2023-07-24 18:07:54,515 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:54,515 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=4e5159f81417fdb0c731e78ab0e69bd7, regionState=CLOSED 2023-07-24 18:07:54,515 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690222074515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222074515"}]},"ts":"1690222074515"} 2023-07-24 18:07:54,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 18:07:54,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 4e5159f81417fdb0c731e78ab0e69bd7, server=jenkins-hbase4.apache.org,37319,1690221975353 in 196 msec 2023-07-24 18:07:54,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 18:07:54,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=4e5159f81417fdb0c731e78ab0e69bd7, UNASSIGN in 205 msec 2023-07-24 18:07:54,523 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222074523"}]},"ts":"1690222074523"} 2023-07-24 18:07:54,525 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 18:07:54,527 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 18:07:54,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 229 msec 2023-07-24 18:07:54,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 18:07:54,609 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 18:07:54,610 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,614 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,615 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,617 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,621 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,621 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,621 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,621 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 18:07:54,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 18:07:54,622 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 18:07:54,623 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,623 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,624 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:54,624 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:54,623 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,624 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:54,624 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:54,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 18:07:54,625 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:54,626 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,626 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:54,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 18:07:54,629 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 18:07:54,629 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:54,629 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:54,630 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:54,631 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/recovered.edits] 2023-07-24 18:07:54,637 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/5e899c45cbc340468f0a4a43dea8022b.6b33482b7c96d9d6096e3f802b9bf96b to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/5e899c45cbc340468f0a4a43dea8022b.6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:54,639 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/782e637d70c24589afb3859d2fa5ea28.a063bbb153d6f2140ab77b370145119c to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/cf/782e637d70c24589afb3859d2fa5ea28.a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:54,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/recovered.edits/12.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7/recovered.edits/12.seqid 2023-07-24 18:07:54,643 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/4e5159f81417fdb0c731e78ab0e69bd7 2023-07-24 18:07:54,644 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:54,646 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:54,647 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/recovered.edits] 2023-07-24 18:07:54,652 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/recovered.edits] 2023-07-24 18:07:54,655 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf/5e899c45cbc340468f0a4a43dea8022b to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/cf/5e899c45cbc340468f0a4a43dea8022b 2023-07-24 18:07:54,661 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/recovered.edits/8.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b/recovered.edits/8.seqid 2023-07-24 18:07:54,661 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6b33482b7c96d9d6096e3f802b9bf96b 2023-07-24 18:07:54,663 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf/782e637d70c24589afb3859d2fa5ea28 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/cf/782e637d70c24589afb3859d2fa5ea28 2023-07-24 18:07:54,668 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/recovered.edits/8.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c/recovered.edits/8.seqid 2023-07-24 18:07:54,669 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a063bbb153d6f2140ab77b370145119c 2023-07-24 18:07:54,669 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 18:07:54,674 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,677 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 18:07:54,690 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 18:07:54,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 18:07:54,692 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222074692"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:54,700 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 18:07:54,700 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4e5159f81417fdb0c731e78ab0e69bd7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690222055593.4e5159f81417fdb0c731e78ab0e69bd7.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 18:07:54,700 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 18:07:54,701 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222074700"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:54,706 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 18:07:54,711 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:54,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 101 msec 2023-07-24 18:07:54,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 18:07:54,727 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 18:07:54,727 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:54,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:54,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:54,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 18:07:54,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222074737"}]},"ts":"1690222074737"} 2023-07-24 18:07:54,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 18:07:54,741 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 18:07:54,742 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, UNASSIGN}] 2023-07-24 18:07:54,744 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, UNASSIGN 2023-07-24 18:07:54,746 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, UNASSIGN 2023-07-24 18:07:54,751 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a45d107fd53653d793e6f6bb24dba009, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:54,751 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=cd4d4c515b9fd374657ed92b4ec16b7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:54,751 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222074751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222074751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222074751"}]},"ts":"1690222074751"} 2023-07-24 18:07:54,752 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222074751"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222074751"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222074751"}]},"ts":"1690222074751"} 2023-07-24 18:07:54,755 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure a45d107fd53653d793e6f6bb24dba009, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:07:54,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure cd4d4c515b9fd374657ed92b4ec16b7d, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:07:54,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 18:07:54,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:54,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a45d107fd53653d793e6f6bb24dba009, disabling compactions & flushes 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cd4d4c515b9fd374657ed92b4ec16b7d, disabling compactions & flushes 2023-07-24 18:07:54,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. after waiting 0 ms 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:54,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. after waiting 0 ms 2023-07-24 18:07:54,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:54,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:07:54,947 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:54,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009. 2023-07-24 18:07:54,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a45d107fd53653d793e6f6bb24dba009: 2023-07-24 18:07:54,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:07:54,973 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:07:54,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d. 2023-07-24 18:07:54,974 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cd4d4c515b9fd374657ed92b4ec16b7d: 2023-07-24 18:07:54,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:54,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=a45d107fd53653d793e6f6bb24dba009, regionState=CLOSED 2023-07-24 18:07:54,976 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222074976"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222074976"}]},"ts":"1690222074976"} 2023-07-24 18:07:54,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:54,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=cd4d4c515b9fd374657ed92b4ec16b7d, regionState=CLOSED 2023-07-24 18:07:54,977 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690222074977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222074977"}]},"ts":"1690222074977"} 2023-07-24 18:07:54,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-24 18:07:54,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure a45d107fd53653d793e6f6bb24dba009, server=jenkins-hbase4.apache.org,34839,1690221975292 in 223 msec 2023-07-24 18:07:54,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-24 18:07:54,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure cd4d4c515b9fd374657ed92b4ec16b7d, server=jenkins-hbase4.apache.org,42037,1690221975401 in 222 msec 2023-07-24 18:07:54,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=a45d107fd53653d793e6f6bb24dba009, UNASSIGN in 238 msec 2023-07-24 18:07:54,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-24 18:07:54,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=cd4d4c515b9fd374657ed92b4ec16b7d, UNASSIGN in 239 msec 2023-07-24 18:07:54,984 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222074983"}]},"ts":"1690222074983"} 2023-07-24 18:07:54,985 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 18:07:54,986 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 18:07:54,989 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 259 msec 2023-07-24 18:07:55,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 18:07:55,038 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 18:07:55,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,047 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,048 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,050 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,053 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,053 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,054 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,054 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 18:07:55,054 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 18:07:55,058 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 18:07:55,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 18:07:55,060 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:55,060 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:55,063 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/recovered.edits] 2023-07-24 18:07:55,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 18:07:55,064 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/recovered.edits] 2023-07-24 18:07:55,070 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf/c6a362dd12734bf5bc2971bd66743de6 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/cf/c6a362dd12734bf5bc2971bd66743de6 2023-07-24 18:07:55,070 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf/8fb8bfd58f2c44d7833108f05328a34a to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/cf/8fb8bfd58f2c44d7833108f05328a34a 2023-07-24 18:07:55,075 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009/recovered.edits/9.seqid 2023-07-24 18:07:55,076 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/a45d107fd53653d793e6f6bb24dba009 2023-07-24 18:07:55,076 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d/recovered.edits/9.seqid 2023-07-24 18:07:55,077 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/cd4d4c515b9fd374657ed92b4ec16b7d 2023-07-24 18:07:55,077 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 18:07:55,077 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 18:07:55,078 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 18:07:55,083 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307242a0914115b69440988a883e1f45cab2a to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202307242a0914115b69440988a883e1f45cab2a 2023-07-24 18:07:55,085 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e8aaca1025a749898dbe2b8fa459a509 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724e8aaca1025a749898dbe2b8fa459a509 2023-07-24 18:07:55,086 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 18:07:55,088 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,096 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 18:07:55,108 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 18:07:55,109 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,109 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 18:07:55,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222075109"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:55,110 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222075109"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:55,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 18:07:55,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cd4d4c515b9fd374657ed92b4ec16b7d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690222053318.cd4d4c515b9fd374657ed92b4ec16b7d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a45d107fd53653d793e6f6bb24dba009, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690222053318.a45d107fd53653d793e6f6bb24dba009.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 18:07:55,112 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 18:07:55,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222075112"}]},"ts":"9223372036854775807"} 2023-07-24 18:07:55,113 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 18:07:55,116 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,117 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 73 msec 2023-07-24 18:07:55,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 18:07:55,165 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 18:07:55,181 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 18:07:55,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 18:07:55,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 18:07:55,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 18:07:55,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 18:07:55,242 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 741) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:33650 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4334 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:46242 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:40520 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:36263 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-640847740_1 at /127.0.0.1:40496 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-640847740_1 at /127.0.0.1:33634 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 902) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=644 (was 536) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=5204 (was 5805) 2023-07-24 18:07:55,242 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 18:07:55,276 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=644, ProcessCount=184, AvailableMemoryMB=5196 2023-07-24 18:07:55,276 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 18:07:55,278 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 18:07:55,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:07:55,283 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:07:55,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 18:07:55,284 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:07:55,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 18:07:55,290 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:55,290 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f 2023-07-24 18:07:55,291 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 empty. 2023-07-24 18:07:55,292 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:55,292 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f empty. 2023-07-24 18:07:55,292 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f 2023-07-24 18:07:55,292 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 18:07:55,345 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 18:07:55,347 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7e02cf7fac9c8ad81964fc0ea826a708, NAME => 'testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:55,348 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 40121efd62ff15179593236c891c119f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:07:55,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 18:07:55,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:55,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7e02cf7fac9c8ad81964fc0ea826a708, disabling compactions & flushes 2023-07-24 18:07:55,482 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:55,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:55,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. after waiting 0 ms 2023-07-24 18:07:55,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:55,482 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:55,482 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7e02cf7fac9c8ad81964fc0ea826a708: 2023-07-24 18:07:55,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 18:07:55,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 18:07:55,892 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:55,892 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 40121efd62ff15179593236c891c119f, disabling compactions & flushes 2023-07-24 18:07:55,892 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:55,892 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:55,892 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. after waiting 0 ms 2023-07-24 18:07:55,892 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:55,892 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:55,892 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 40121efd62ff15179593236c891c119f: 2023-07-24 18:07:55,894 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:07:55,895 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222075895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222075895"}]},"ts":"1690222075895"} 2023-07-24 18:07:55,896 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222075895"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222075895"}]},"ts":"1690222075895"} 2023-07-24 18:07:55,897 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:07:55,898 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:07:55,898 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222075898"}]},"ts":"1690222075898"} 2023-07-24 18:07:55,900 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 18:07:55,903 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:07:55,904 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:07:55,904 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:07:55,904 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:07:55,904 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:07:55,904 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, ASSIGN}] 2023-07-24 18:07:55,908 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, ASSIGN 2023-07-24 18:07:55,908 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, ASSIGN 2023-07-24 18:07:55,910 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42037,1690221975401; forceNewPlan=false, retain=false 2023-07-24 18:07:55,910 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37319,1690221975353; forceNewPlan=false, retain=false 2023-07-24 18:07:56,060 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:07:56,063 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7e02cf7fac9c8ad81964fc0ea826a708, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=40121efd62ff15179593236c891c119f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,064 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222076063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222076063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222076063"}]},"ts":"1690222076063"} 2023-07-24 18:07:56,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222076063"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222076063"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222076063"}]},"ts":"1690222076063"} 2023-07-24 18:07:56,066 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 7e02cf7fac9c8ad81964fc0ea826a708, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:07:56,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 40121efd62ff15179593236c891c119f, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:07:56,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:56,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40121efd62ff15179593236c891c119f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 18:07:56,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. service=AccessControlService 2023-07-24 18:07:56,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:56,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:56,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7e02cf7fac9c8ad81964fc0ea826a708, NAME => 'testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 18:07:56,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. service=AccessControlService 2023-07-24 18:07:56,227 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:07:56,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:07:56,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,232 INFO [StoreOpener-40121efd62ff15179593236c891c119f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,242 INFO [StoreOpener-7e02cf7fac9c8ad81964fc0ea826a708-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,243 DEBUG [StoreOpener-40121efd62ff15179593236c891c119f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf 2023-07-24 18:07:56,243 DEBUG [StoreOpener-40121efd62ff15179593236c891c119f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf 2023-07-24 18:07:56,244 INFO [StoreOpener-40121efd62ff15179593236c891c119f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40121efd62ff15179593236c891c119f columnFamilyName cf 2023-07-24 18:07:56,245 DEBUG [StoreOpener-7e02cf7fac9c8ad81964fc0ea826a708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf 2023-07-24 18:07:56,246 DEBUG [StoreOpener-7e02cf7fac9c8ad81964fc0ea826a708-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf 2023-07-24 18:07:56,246 INFO [StoreOpener-40121efd62ff15179593236c891c119f-1] regionserver.HStore(310): Store=40121efd62ff15179593236c891c119f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:56,247 INFO [StoreOpener-7e02cf7fac9c8ad81964fc0ea826a708-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7e02cf7fac9c8ad81964fc0ea826a708 columnFamilyName cf 2023-07-24 18:07:56,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,248 INFO [StoreOpener-7e02cf7fac9c8ad81964fc0ea826a708-1] regionserver.HStore(310): Store=7e02cf7fac9c8ad81964fc0ea826a708/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:07:56,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:07:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 40121efd62ff15179593236c891c119f 2023-07-24 18:07:56,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:56,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7e02cf7fac9c8ad81964fc0ea826a708; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74833454, jitterRate=0.11510536074638367}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7e02cf7fac9c8ad81964fc0ea826a708: 2023-07-24 18:07:56,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708., pid=93, masterSystemTime=1690222076218 2023-07-24 18:07:56,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,273 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7e02cf7fac9c8ad81964fc0ea826a708, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,273 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222076273"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222076273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222076273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222076273"}]},"ts":"1690222076273"} 2023-07-24 18:07:56,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:07:56,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 40121efd62ff15179593236c891c119f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63914617, jitterRate=-0.047597989439964294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:07:56,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 40121efd62ff15179593236c891c119f: 2023-07-24 18:07:56,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f., pid=94, masterSystemTime=1690222076220 2023-07-24 18:07:56,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:56,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:56,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-24 18:07:56,288 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 7e02cf7fac9c8ad81964fc0ea826a708, server=jenkins-hbase4.apache.org,37319,1690221975353 in 209 msec 2023-07-24 18:07:56,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=40121efd62ff15179593236c891c119f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222076288"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222076288"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222076288"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222076288"}]},"ts":"1690222076288"} 2023-07-24 18:07:56,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, ASSIGN in 384 msec 2023-07-24 18:07:56,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-24 18:07:56,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 40121efd62ff15179593236c891c119f, server=jenkins-hbase4.apache.org,42037,1690221975401 in 224 msec 2023-07-24 18:07:56,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 18:07:56,296 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, ASSIGN in 389 msec 2023-07-24 18:07:56,298 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:07:56,299 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222076298"}]},"ts":"1690222076298"} 2023-07-24 18:07:56,300 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 18:07:56,304 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:07:56,304 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 18:07:56,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 18:07:56,312 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:56,312 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:56,313 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:56,313 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:07:56,316 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:56,317 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:56,317 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:56,317 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 18:07:56,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 1.0370 sec 2023-07-24 18:07:56,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 18:07:56,392 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 18:07:56,394 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 18:07:56,394 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,398 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:07:56,421 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:07:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222076421 (current time:1690222076421). 2023-07-24 18:07:56,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:56,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x709f834f to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:56,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@183c6ab5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:56,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:56,460 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:56,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x709f834f to 127.0.0.1:57118 2023-07-24 18:07:56,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:56,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x316c0f7d to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:56,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d6567e4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:56,503 DEBUG [hconnection-0x46f7cb3f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:56,504 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:56,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x316c0f7d to 127.0.0.1:57118 2023-07-24 18:07:56,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:56,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 18:07:56,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:56,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:07:56,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:07:56,517 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:07:56,520 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690222676520 2023-07-24 18:07:56,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:07:56,520 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 18:07:56,523 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:07:56,523 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 18:07:56,523 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:56,523 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:56,524 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-24 18:07:56,528 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 18:07:56,531 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690222676531 2023-07-24 18:07:56,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,543 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 18:07:56,543 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,544 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 18:07:56,544 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 18:07:56,545 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,545 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,552 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,553 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,553 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,553 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,553 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,553 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,554 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,554 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 18:07:56,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 18:07:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 18:07:56,564 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 18:07:56,564 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 18:07:56,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,564 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,565 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 18:07:56,565 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 18:07:56,565 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,565 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 18:07:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 18:07:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 18:07:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 18:07:56,566 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,567 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 18:07:56,567 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 18:07:56,567 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 18:07:56,569 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,569 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,569 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,570 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,570 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2232e8f6[Count = 1] remaining members to acquire global barrier 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 18:07:56,575 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2232e8f6[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:56,575 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 18:07:56,575 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:07:56,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:56,576 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,577 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,577 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. started... 2023-07-24 18:07:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,576 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:07:56,577 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e02cf7fac9c8ad81964fc0ea826a708: 2023-07-24 18:07:56,577 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:07:56,577 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 18:07:56,577 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,577 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:56,577 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,577 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:56,577 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:56,577 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:07:56,578 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:56,578 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:56,579 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:56,579 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. started... 2023-07-24 18:07:56,580 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40121efd62ff15179593236c891c119f: 2023-07-24 18:07:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 18:07:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:56,581 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,581 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 18:07:56,582 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:56,582 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:07:56,605 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. completed. 2023-07-24 18:07:56,605 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 18:07:56,605 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:56,607 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 18:07:56,607 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,607 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,608 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. completed. 2023-07-24 18:07:56,608 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 18:07:56,610 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:56,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:56,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 18:07:56,610 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,612 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 18:07:56,612 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:56,612 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 18:07:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,612 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37319,1690221975353': 2023-07-24 18:07:56,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 18:07:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,623 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:56,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:07:56,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,625 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:56,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:07:56,625 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 18:07:56,625 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 18:07:56,625 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:56,625 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:56,625 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,625 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:56,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:56,629 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,629 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,629 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:56,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,628 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:56,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:56,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:56,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,632 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,632 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,633 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,638 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,638 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,638 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,638 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,639 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:56,639 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:56,639 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState because node does not exist (not an error) 2023-07-24 18:07:56,639 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:56,638 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,638 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:56,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,641 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:56,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:56,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 18:07:56,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:56,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:56,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:07:56,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 18:07:56,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 18:07:56,754 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,755 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690222076520Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690222076657 (+137 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690222076657Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690222076657Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690222076685 (+28 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690222076713 (+28 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690222076754 (+41 ms) 2023-07-24 18:07:56,760 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 18:07:56,762 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 239 msec 2023-07-24 18:07:56,825 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:56,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:07:56,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:56,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42037] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:07:56,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37319] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:07:56,839 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 18:07:56,839 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,839 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:07:56,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:07:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222076851 (current time:1690222076851). 2023-07-24 18:07:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:07:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x53ea0674 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b3c8105, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:56,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:56,865 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:56,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53ea0674 to 127.0.0.1:57118 2023-07-24 18:07:56,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:56,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x4d8c972e to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:07:56,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ed6e14d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:07:56,881 DEBUG [hconnection-0x1ad653b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:07:56,886 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38272, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:07:56,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4d8c972e to 127.0.0.1:57118 2023-07-24 18:07:56,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:07:56,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 18:07:56,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:07:56,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:07:56,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:07:56,895 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:07:56,896 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690222676896 2023-07-24 18:07:56,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 18:07:56,896 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 18:07:56,897 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:07:56,898 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 18:07:56,898 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:07:56,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 18:07:56,899 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-24 18:07:56,900 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 18:07:56,901 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690222676901 2023-07-24 18:07:56,958 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,958 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 18:07:56,959 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,960 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 18:07:56,960 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 18:07:56,961 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,961 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,963 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,963 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,963 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,963 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:56,963 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,963 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,968 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,968 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:07:56,968 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 18:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,969 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 18:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,969 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 18:07:56,970 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,971 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 18:07:56,973 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 18:07:56,973 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,973 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 18:07:56,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 18:07:56,974 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:07:56,975 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 18:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 18:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 18:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 18:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,978 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 18:07:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 18:07:56,979 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,979 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:56,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,981 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:56,981 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:07:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a447c2[Count = 1] remaining members to acquire global barrier 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 18:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73a447c2[Count = 0] remaining members to acquire global barrier 2023-07-24 18:07:56,990 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 18:07:56,990 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,993 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,993 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,993 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:07:56,994 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 18:07:56,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:07:56,994 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:56,994 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:07:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 18:07:56,994 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:56,994 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:56,994 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. started... 2023-07-24 18:07:56,995 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:07:56,995 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:07:56,995 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:56,995 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 40121efd62ff15179593236c891c119f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 18:07:56,995 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. started... 2023-07-24 18:07:56,995 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7e02cf7fac9c8ad81964fc0ea826a708 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 18:07:56,996 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 18:07:56,996 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:56,996 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 18:07:56,998 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:57,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:07:57,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:57,002 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:07:57,031 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072463b1c68698814833a230f54a6fc414c4 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072463b1c68698814833a230f54a6fc414c4 2023-07-24 18:07:57,034 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072477de5a603c2f4d0e9166978082ee0d3e to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072477de5a603c2f4d0e9166978082ee0d3e 2023-07-24 18:07:57,047 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/.tmp/cf/4aad53151d364863a87eb3a88f3856b9 2023-07-24 18:07:57,049 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/.tmp/cf/57205c7f58b5456c9df4857416e69c8d 2023-07-24 18:07:57,052 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/.tmp/cf/4aad53151d364863a87eb3a88f3856b9 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf/4aad53151d364863a87eb3a88f3856b9 2023-07-24 18:07:57,055 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/.tmp/cf/57205c7f58b5456c9df4857416e69c8d as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf/57205c7f58b5456c9df4857416e69c8d 2023-07-24 18:07:57,058 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf/4aad53151d364863a87eb3a88f3856b9, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 18:07:57,060 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7e02cf7fac9c8ad81964fc0ea826a708 in 65ms, sequenceid=6, compaction requested=false 2023-07-24 18:07:57,060 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 18:07:57,061 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7e02cf7fac9c8ad81964fc0ea826a708: 2023-07-24 18:07:57,061 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,061 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:57,061 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf/4aad53151d364863a87eb3a88f3856b9] hfiles 2023-07-24 18:07:57,061 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf/4aad53151d364863a87eb3a88f3856b9 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,063 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf/57205c7f58b5456c9df4857416e69c8d, entries=47, sequenceid=6, filesize=13.1 K 2023-07-24 18:07:57,064 INFO [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 40121efd62ff15179593236c891c119f in 68ms, sequenceid=6, compaction requested=false 2023-07-24 18:07:57,065 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40121efd62ff15179593236c891c119f: 2023-07-24 18:07:57,066 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,066 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:07:57,066 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf/57205c7f58b5456c9df4857416e69c8d] hfiles 2023-07-24 18:07:57,066 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf/57205c7f58b5456c9df4857416e69c8d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,093 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. completed. 2023-07-24 18:07:57,093 DEBUG [rs(jenkins-hbase4.apache.org,42037,1690221975401)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 18:07:57,093 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:07:57,094 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. completed. 2023-07-24 18:07:57,094 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:07:57,094 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:07:57,094 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:07:57,094 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,094 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 18:07:57,094 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:07:57,095 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 18:07:57,095 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,095 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:57,096 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 18:07:57,098 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:57,098 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 18:07:57,098 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:57,098 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 18:07:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:57,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,42037,1690221975401': 2023-07-24 18:07:57,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 18:07:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37319,1690221975353': 2023-07-24 18:07:57,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 18:07:57,115 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 18:07:57,115 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:07:57,115 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:07:57,115 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,115 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:07:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:57,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:07:57,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:57,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:57,118 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,118 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:07:57,120 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,120 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:07:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,122 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,123 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,123 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:57,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:57,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:57,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:07:57,127 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 18:07:57,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:07:57,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:07:57,127 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:07:57,127 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:57,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:07:57,129 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:57,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:57,128 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,130 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:57,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:57,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:07:57,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:07:57,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072477de5a603c2f4d0e9166978082ee0d3e, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072463b1c68698814833a230f54a6fc414c4] mob files 2023-07-24 18:07:57,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072477de5a603c2f4d0e9166978082ee0d3e 2023-07-24 18:07:57,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072463b1c68698814833a230f54a6fc414c4 2023-07-24 18:07:57,202 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:57,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:07:57,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:57,204 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:07:57,504 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:57,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:07:57,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:07:57,505 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:07:57,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 18:07:57,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,625 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:57,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690222076896Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690222077554 (+658 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690222077554Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690222077555 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690222077559 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690222077579 (+20 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690222077624 (+45 ms) 2023-07-24 18:07:57,631 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 18:07:57,633 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 734 msec 2023-07-24 18:07:58,005 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:07:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 18:07:58,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:07:58,009 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009 2023-07-24 18:07:58,009 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35665, tgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009, rawTgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:58,043 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:07:58,043 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1827082890_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:58,043 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 18:07:58,054 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:07:58,100 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,101 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,102 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,102 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,103 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,103 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,103 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,192 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-1037429429937605852.jar 2023-07-24 18:07:58,192 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,193 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,193 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,193 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,194 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,194 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:07:58,194 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:07:58,195 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:07:58,195 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:07:58,196 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:07:58,196 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:07:58,197 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:07:58,198 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:07:58,198 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:07:58,199 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:07:58,199 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:07:58,200 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:58,200 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:58,201 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:58,201 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:58,201 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:07:58,202 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:58,203 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:07:58,774 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0005_000001 (auth:SIMPLE) 2023-07-24 18:07:59,665 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:07:59,668 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 18:07:59,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:59,723 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:07:59,776 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0006_000001 (auth:SIMPLE) 2023-07-24 18:08:00,135 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:08:05,144 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0006_000001 (auth:SIMPLE) 2023-07-24 18:08:08,049 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:08:08,050 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:08:08,061 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:08:08,061 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:08:08,062 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:08:08,062 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:08:08,063 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 18:08:08,063 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 18:08:08,063 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:08:08,063 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 18:08:08,063 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222078009/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 18:08:08,072 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 18:08:08,077 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222088077"}]},"ts":"1690222088077"} 2023-07-24 18:08:08,079 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 18:08:08,080 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 18:08:08,081 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, UNASSIGN}] 2023-07-24 18:08:08,084 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, UNASSIGN 2023-07-24 18:08:08,084 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, UNASSIGN 2023-07-24 18:08:08,085 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7e02cf7fac9c8ad81964fc0ea826a708, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:08,085 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=40121efd62ff15179593236c891c119f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:08,085 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222088084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222088084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222088084"}]},"ts":"1690222088084"} 2023-07-24 18:08:08,085 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222088085"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222088085"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222088085"}]},"ts":"1690222088085"} 2023-07-24 18:08:08,086 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 40121efd62ff15179593236c891c119f, server=jenkins-hbase4.apache.org,42037,1690221975401}] 2023-07-24 18:08:08,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 7e02cf7fac9c8ad81964fc0ea826a708, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:08:08,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 18:08:08,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 40121efd62ff15179593236c891c119f 2023-07-24 18:08:08,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 40121efd62ff15179593236c891c119f, disabling compactions & flushes 2023-07-24 18:08:08,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:08:08,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:08:08,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. after waiting 0 ms 2023-07-24 18:08:08,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:08:08,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:08:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7e02cf7fac9c8ad81964fc0ea826a708, disabling compactions & flushes 2023-07-24 18:08:08,245 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:08:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:08:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. after waiting 0 ms 2023-07-24 18:08:08,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:08:08,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:08:08,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:08,294 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f. 2023-07-24 18:08:08,294 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 40121efd62ff15179593236c891c119f: 2023-07-24 18:08:08,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:08:08,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 40121efd62ff15179593236c891c119f 2023-07-24 18:08:08,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:08,298 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=40121efd62ff15179593236c891c119f, regionState=CLOSED 2023-07-24 18:08:08,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708. 2023-07-24 18:08:08,299 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222088297"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222088297"}]},"ts":"1690222088297"} 2023-07-24 18:08:08,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7e02cf7fac9c8ad81964fc0ea826a708: 2023-07-24 18:08:08,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:08:08,302 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7e02cf7fac9c8ad81964fc0ea826a708, regionState=CLOSED 2023-07-24 18:08:08,302 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690222088302"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222088302"}]},"ts":"1690222088302"} 2023-07-24 18:08:08,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-24 18:08:08,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 40121efd62ff15179593236c891c119f, server=jenkins-hbase4.apache.org,42037,1690221975401 in 215 msec 2023-07-24 18:08:08,307 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40121efd62ff15179593236c891c119f, UNASSIGN in 223 msec 2023-07-24 18:08:08,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-24 18:08:08,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 7e02cf7fac9c8ad81964fc0ea826a708, server=jenkins-hbase4.apache.org,37319,1690221975353 in 217 msec 2023-07-24 18:08:08,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 18:08:08,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7e02cf7fac9c8ad81964fc0ea826a708, UNASSIGN in 227 msec 2023-07-24 18:08:08,310 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222088310"}]},"ts":"1690222088310"} 2023-07-24 18:08:08,311 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 18:08:08,313 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 18:08:08,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 241 msec 2023-07-24 18:08:08,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 18:08:08,380 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 18:08:08,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,390 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,392 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,394 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,397 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,397 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,397 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,398 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 18:08:08,398 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 18:08:08,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 18:08:08,399 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,400 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:08,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 18:08:08,402 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f 2023-07-24 18:08:08,403 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:08:08,405 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/recovered.edits] 2023-07-24 18:08:08,405 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/recovered.edits] 2023-07-24 18:08:08,410 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf/57205c7f58b5456c9df4857416e69c8d to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/cf/57205c7f58b5456c9df4857416e69c8d 2023-07-24 18:08:08,410 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf/4aad53151d364863a87eb3a88f3856b9 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/cf/4aad53151d364863a87eb3a88f3856b9 2023-07-24 18:08:08,414 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f/recovered.edits/9.seqid 2023-07-24 18:08:08,415 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/40121efd62ff15179593236c891c119f 2023-07-24 18:08:08,416 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708/recovered.edits/9.seqid 2023-07-24 18:08:08,416 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testEmptyExportFileSystemState/7e02cf7fac9c8ad81964fc0ea826a708 2023-07-24 18:08:08,417 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 18:08:08,417 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 18:08:08,418 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 18:08:08,423 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072477de5a603c2f4d0e9166978082ee0d3e to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072477de5a603c2f4d0e9166978082ee0d3e 2023-07-24 18:08:08,424 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072463b1c68698814833a230f54a6fc414c4 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072463b1c68698814833a230f54a6fc414c4 2023-07-24 18:08:08,425 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 18:08:08,428 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,436 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 18:08:08,442 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 18:08:08,445 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,445 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 18:08:08,445 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222088445"}]},"ts":"9223372036854775807"} 2023-07-24 18:08:08,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222088445"}]},"ts":"9223372036854775807"} 2023-07-24 18:08:08,459 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 18:08:08,459 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7e02cf7fac9c8ad81964fc0ea826a708, NAME => 'testtb-testEmptyExportFileSystemState,,1690222075278.7e02cf7fac9c8ad81964fc0ea826a708.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 40121efd62ff15179593236c891c119f, NAME => 'testtb-testEmptyExportFileSystemState,1,1690222075278.40121efd62ff15179593236c891c119f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 18:08:08,459 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 18:08:08,459 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222088459"}]},"ts":"9223372036854775807"} 2023-07-24 18:08:08,473 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 18:08:08,475 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 18:08:08,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 94 msec 2023-07-24 18:08:08,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 18:08:08,503 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 18:08:08,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 18:08:08,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 18:08:08,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 18:08:08,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 18:08:08,565 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 759) Potentially hanging thread: Thread-5019 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:56676 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:56932 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35781 from appattempt_1690221983197_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_195702468_1 at /127.0.0.1:56652 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_195702468_1 at /127.0.0.1:52394 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:52426 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:37425 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:35781 from appattempt_1690221983197_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=922 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=676 (was 644) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=4586 (was 5196) 2023-07-24 18:08:08,565 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 18:08:08,606 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=922, MaxFileDescriptor=60000, SystemLoadAverage=676, ProcessCount=181, AvailableMemoryMB=4584 2023-07-24 18:08:08,606 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 18:08:08,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 18:08:08,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:08,613 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 18:08:08,613 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 18:08:08,614 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 18:08:08,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 18:08:08,619 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:08,619 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:08,620 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 empty. 2023-07-24 18:08:08,620 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 empty. 2023-07-24 18:08:08,621 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:08,621 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:08,621 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 18:08:08,686 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 18:08:08,687 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c2e79c018c8f64e0ff14aad731cf2818, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:08:08,691 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => a6242d36d942569ee6c71af50b6ebfb0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp 2023-07-24 18:08:08,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 18:08:08,783 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:08:08,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing a6242d36d942569ee6c71af50b6ebfb0, disabling compactions & flushes 2023-07-24 18:08:08,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:08,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:08,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. after waiting 0 ms 2023-07-24 18:08:08,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:08,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:08,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for a6242d36d942569ee6c71af50b6ebfb0: 2023-07-24 18:08:08,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:08:08,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c2e79c018c8f64e0ff14aad731cf2818, disabling compactions & flushes 2023-07-24 18:08:08,788 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:08,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:08,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. after waiting 0 ms 2023-07-24 18:08:08,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:08,788 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:08,788 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c2e79c018c8f64e0ff14aad731cf2818: 2023-07-24 18:08:08,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 18:08:08,795 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222088795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222088795"}]},"ts":"1690222088795"} 2023-07-24 18:08:08,795 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222088795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222088795"}]},"ts":"1690222088795"} 2023-07-24 18:08:08,798 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 18:08:08,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 18:08:08,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222088803"}]},"ts":"1690222088803"} 2023-07-24 18:08:08,805 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 18:08:08,810 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 18:08:08,811 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 18:08:08,812 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 18:08:08,812 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 18:08:08,812 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 18:08:08,812 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, ASSIGN}] 2023-07-24 18:08:08,818 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, ASSIGN 2023-07-24 18:08:08,818 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, ASSIGN 2023-07-24 18:08:08,822 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34839,1690221975292; forceNewPlan=false, retain=false 2023-07-24 18:08:08,822 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37319,1690221975353; forceNewPlan=false, retain=false 2023-07-24 18:08:08,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 18:08:08,972 INFO [jenkins-hbase4:42435] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 18:08:08,976 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c2e79c018c8f64e0ff14aad731cf2818, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:08,976 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222088976"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222088976"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222088976"}]},"ts":"1690222088976"} 2023-07-24 18:08:08,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a6242d36d942569ee6c71af50b6ebfb0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:08,977 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222088977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222088977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222088977"}]},"ts":"1690222088977"} 2023-07-24 18:08:08,984 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure c2e79c018c8f64e0ff14aad731cf2818, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:08:08,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure a6242d36d942569ee6c71af50b6ebfb0, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:08:09,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:09,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c2e79c018c8f64e0ff14aad731cf2818, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 18:08:09,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. service=AccessControlService 2023-07-24 18:08:09,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:08:09,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:08:09,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,172 INFO [StoreOpener-c2e79c018c8f64e0ff14aad731cf2818-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:09,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a6242d36d942569ee6c71af50b6ebfb0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 18:08:09,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. service=AccessControlService 2023-07-24 18:08:09,175 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 18:08:09,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 18:08:09,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,176 DEBUG [StoreOpener-c2e79c018c8f64e0ff14aad731cf2818-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf 2023-07-24 18:08:09,176 DEBUG [StoreOpener-c2e79c018c8f64e0ff14aad731cf2818-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf 2023-07-24 18:08:09,176 INFO [StoreOpener-c2e79c018c8f64e0ff14aad731cf2818-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c2e79c018c8f64e0ff14aad731cf2818 columnFamilyName cf 2023-07-24 18:08:09,184 INFO [StoreOpener-c2e79c018c8f64e0ff14aad731cf2818-1] regionserver.HStore(310): Store=c2e79c018c8f64e0ff14aad731cf2818/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:08:09,191 INFO [StoreOpener-a6242d36d942569ee6c71af50b6ebfb0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,194 DEBUG [StoreOpener-a6242d36d942569ee6c71af50b6ebfb0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf 2023-07-24 18:08:09,194 DEBUG [StoreOpener-a6242d36d942569ee6c71af50b6ebfb0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf 2023-07-24 18:08:09,194 INFO [StoreOpener-a6242d36d942569ee6c71af50b6ebfb0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a6242d36d942569ee6c71af50b6ebfb0 columnFamilyName cf 2023-07-24 18:08:09,196 INFO [StoreOpener-a6242d36d942569ee6c71af50b6ebfb0-1] regionserver.HStore(310): Store=a6242d36d942569ee6c71af50b6ebfb0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 18:08:09,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:09,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:09,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:08:09,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c2e79c018c8f64e0ff14aad731cf2818; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69948575, jitterRate=0.04231499135494232}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:08:09,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c2e79c018c8f64e0ff14aad731cf2818: 2023-07-24 18:08:09,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 18:08:09,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818., pid=108, masterSystemTime=1690222089137 2023-07-24 18:08:09,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 18:08:09,224 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a6242d36d942569ee6c71af50b6ebfb0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62094075, jitterRate=-0.0747261792421341}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 18:08:09,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a6242d36d942569ee6c71af50b6ebfb0: 2023-07-24 18:08:09,225 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0., pid=109, masterSystemTime=1690222089137 2023-07-24 18:08:09,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:09,226 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:09,236 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c2e79c018c8f64e0ff14aad731cf2818, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:09,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:09,237 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=a6242d36d942569ee6c71af50b6ebfb0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,238 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222089237"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222089237"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222089237"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222089237"}]},"ts":"1690222089237"} 2023-07-24 18:08:09,236 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222089236"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690222089236"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690222089236"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690222089236"}]},"ts":"1690222089236"} 2023-07-24 18:08:09,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-24 18:08:09,243 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure a6242d36d942569ee6c71af50b6ebfb0, server=jenkins-hbase4.apache.org,34839,1690221975292 in 255 msec 2023-07-24 18:08:09,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-24 18:08:09,245 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure c2e79c018c8f64e0ff14aad731cf2818, server=jenkins-hbase4.apache.org,37319,1690221975353 in 257 msec 2023-07-24 18:08:09,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, ASSIGN in 431 msec 2023-07-24 18:08:09,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 18:08:09,247 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, ASSIGN in 433 msec 2023-07-24 18:08:09,248 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 18:08:09,248 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222089248"}]},"ts":"1690222089248"} 2023-07-24 18:08:09,250 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 18:08:09,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 18:08:09,254 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 18:08:09,256 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 18:08:09,257 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:09,257 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:09,258 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:09,258 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:09,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 18:08:09,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 18:08:09,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 18:08:09,260 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 18:08:09,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 652 msec 2023-07-24 18:08:09,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 18:08:09,725 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 18:08:09,727 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,727 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:09,729 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:08:09,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 18:08:09,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222089743 (current time:1690222089743). 2023-07-24 18:08:09,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:08:09,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x2fffd923 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:08:09,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37540831, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:08:09,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:08:09,755 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:08:09,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2fffd923 to 127.0.0.1:57118 2023-07-24 18:08:09,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:09,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x011b0472 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:08:09,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@507cf3b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:08:09,772 DEBUG [hconnection-0x47fe6c0d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:08:09,777 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:08:09,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x011b0472 to 127.0.0.1:57118 2023-07-24 18:08:09,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:09,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 18:08:09,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:08:09,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 18:08:09,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 18:08:09,789 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 18:08:09,790 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690222689789 2023-07-24 18:08:09,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 18:08:09,790 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,791 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:08:09,791 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:08:09,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 18:08:09,793 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 18:08:09,794 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-24 18:08:09,796 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 18:08:09,796 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690222689796 2023-07-24 18:08:09,817 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,818 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 18:08:09,818 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:09,821 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 18:08:09,821 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 18:08:09,822 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,822 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,823 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:09,823 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:09,823 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:09,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:09,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:09,824 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,825 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,825 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,825 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 18:08:09,826 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 18:08:09,826 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,826 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:08:09,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,826 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 18:08:09,826 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:09,826 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,826 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 18:08:09,826 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:09,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 18:08:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 18:08:09,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 18:08:09,829 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 18:08:09,829 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 18:08:09,828 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 18:08:09,829 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 18:08:09,829 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 18:08:09,836 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,836 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:09,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:09,838 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:08:09,838 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:08:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:09,839 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 18:08:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:09,841 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 18:08:09,841 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 18:08:09,841 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 18:08:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,843 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:09,843 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,843 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:08:09,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:09,844 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 18:08:09,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@540d3c18[Count = 1] remaining members to acquire global barrier 2023-07-24 18:08:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:09,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:09,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 18:08:09,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@540d3c18[Count = 0] remaining members to acquire global barrier 2023-07-24 18:08:09,854 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 18:08:09,855 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,857 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 18:08:09,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,857 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:09,856 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 18:08:09,857 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 18:08:09,857 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 18:08:09,857 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:08:09,858 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:09,858 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:08:09,859 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 18:08:09,859 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:09,859 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 18:08:09,862 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:08:09,863 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:08:09,863 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:09,874 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:08:09,882 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:08:09,882 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. started... 2023-07-24 18:08:09,883 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:09,883 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. started... 2023-07-24 18:08:09,885 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6242d36d942569ee6c71af50b6ebfb0: 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2e79c018c8f64e0ff14aad731cf2818: 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:08:09,886 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 18:08:09,892 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:09,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:09,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:09,900 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:08:10,032 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. completed. 2023-07-24 18:08:10,032 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:08:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:08:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 18:08:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:08:10,032 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. completed. 2023-07-24 18:08:10,032 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:10,032 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:08:10,033 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:08:10,033 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,033 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 18:08:10,033 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:08:10,035 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,035 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 18:08:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:10,035 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:10,035 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 18:08:10,037 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,037 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 18:08:10,037 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:10,037 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 18:08:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:10,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37319,1690221975353': 2023-07-24 18:08:10,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 18:08:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:10,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:10,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:10,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:08:10,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 18:08:10,049 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 18:08:10,049 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:08:10,049 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:08:10,049 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,049 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:08:10,051 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:10,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,052 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,051 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:10,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:10,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:10,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:10,052 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:10,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,053 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,054 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:10,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,056 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:10,056 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,058 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:10,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,063 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:10,062 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:10,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:10,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,065 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:10,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:08:10,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:10,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:10,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 18:08:10,063 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:10,067 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:10,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:10,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:10,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:10,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:10,100 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:10,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:10,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:10,101 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:08:10,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,402 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:10,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:10,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:10,403 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:08:10,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:10,904 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:10,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:10,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:10,905 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 18:08:11,031 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 18:08:11,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:11,031 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:11,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690222089790Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690222090112 (+322 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690222090112Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690222090113 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690222090117 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690222090544 (+427 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690222091031 (+487 ms) 2023-07-24 18:08:11,034 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 18:08:11,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.2430 sec 2023-07-24 18:08:11,905 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:11,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:11,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:08:11,908 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37319] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:08:11,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34839] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 18:08:11,911 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:11,911 DEBUG [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:11,912 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 18:08:11,920 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 18:08:11,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690222091920 (current time:1690222091920). 2023-07-24 18:08:11,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 18:08:11,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x35a439f3 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:08:11,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10eb54e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:08:11,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:08:11,934 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:08:11,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x35a439f3 to 127.0.0.1:57118 2023-07-24 18:08:11,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:11,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(139): Connect 0x55877733 to 127.0.0.1:57118 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 18:08:11,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4178b7d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 18:08:12,047 DEBUG [hconnection-0x3528ce75-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 18:08:12,048 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 18:08:12,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55877733 to 127.0.0.1:57118 2023-07-24 18:08:12,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:12,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 18:08:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 18:08:12,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 18:08:12,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 18:08:12,069 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 18:08:12,070 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690222692070 2023-07-24 18:08:12,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 18:08:12,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,075 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 18:08:12,075 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 18:08:12,075 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 18:08:12,077 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 18:08:12,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 12 msec 2023-07-24 18:08:12,080 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 18:08:12,081 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690222692081 2023-07-24 18:08:12,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,160 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 18:08:12,160 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:12,162 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 18:08:12,162 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 18:08:12,162 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,162 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,166 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:12,166 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:12,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:12,166 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,166 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:12,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:12,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:12,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:12,167 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,167 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,167 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,167 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 18:08:12,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,168 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 18:08:12,168 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 18:08:12,168 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:12,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 18:08:12,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,170 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 18:08:12,170 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 18:08:12,170 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 18:08:12,170 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 18:08:12,168 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:12,171 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,171 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:12,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:12,172 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,172 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:08:12,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:12,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:12,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,176 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 18:08:12,176 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,176 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 18:08:12,176 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 18:08:12,176 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 18:08:12,176 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:12,176 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 18:08:12,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 18:08:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 18:08:12,178 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42037,1690221975401' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 18:08:12,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:12,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:12,179 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 18:08:12,182 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34839,1690221975292' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 18:08:12,183 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@83532ed[Count = 1] remaining members to acquire global barrier 2023-07-24 18:08:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:12,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:12,183 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:12,184 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,184 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:08:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:12,184 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,184 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 18:08:12,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:12,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37319,1690221975353' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 18:08:12,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@83532ed[Count = 0] remaining members to acquire global barrier 2023-07-24 18:08:12,186 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 18:08:12,186 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,198 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,198 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,198 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 18:08:12,199 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 18:08:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 18:08:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42037,1690221975401' in zk 2023-07-24 18:08:12,199 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 18:08:12,200 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,200 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 18:08:12,201 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 18:08:12,201 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:12,201 DEBUG [member: 'jenkins-hbase4.apache.org,42037,1690221975401' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 18:08:12,214 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:08:12,215 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:08:12,233 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 18:08:12,233 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 18:08:12,233 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:12,233 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. started... 2023-07-24 18:08:12,233 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a6242d36d942569ee6c71af50b6ebfb0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 18:08:12,234 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:12,234 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. started... 2023-07-24 18:08:12,234 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c2e79c018c8f64e0ff14aad731cf2818 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 18:08:12,244 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 18:08:12,290 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724646073017db94f259e177f0bc7c5ef8f to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724646073017db94f259e177f0bc7c5ef8f 2023-07-24 18:08:12,292 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724ef2711edc5ac416b9281e5ba3e91f90c to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ef2711edc5ac416b9281e5ba3e91f90c 2023-07-24 18:08:12,305 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/.tmp/cf/bf5e338367de4f6db54a08226f015913 2023-07-24 18:08:12,310 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/.tmp/cf/1c7e65bcf06d474ca8ca76098be01582 2023-07-24 18:08:12,312 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/.tmp/cf/bf5e338367de4f6db54a08226f015913 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf/bf5e338367de4f6db54a08226f015913 2023-07-24 18:08:12,317 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/.tmp/cf/1c7e65bcf06d474ca8ca76098be01582 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf/1c7e65bcf06d474ca8ca76098be01582 2023-07-24 18:08:12,318 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf/bf5e338367de4f6db54a08226f015913, entries=48, sequenceid=6, filesize=13.5 K 2023-07-24 18:08:12,319 INFO [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for a6242d36d942569ee6c71af50b6ebfb0 in 86ms, sequenceid=6, compaction requested=false 2023-07-24 18:08:12,321 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a6242d36d942569ee6c71af50b6ebfb0: 2023-07-24 18:08:12,321 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,321 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:08:12,321 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf/bf5e338367de4f6db54a08226f015913] hfiles 2023-07-24 18:08:12,321 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf/bf5e338367de4f6db54a08226f015913 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,326 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf/1c7e65bcf06d474ca8ca76098be01582, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 18:08:12,327 INFO [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c2e79c018c8f64e0ff14aad731cf2818 in 93ms, sequenceid=6, compaction requested=false 2023-07-24 18:08:12,327 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c2e79c018c8f64e0ff14aad731cf2818: 2023-07-24 18:08:12,327 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,327 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 18:08:12,327 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf/1c7e65bcf06d474ca8ca76098be01582] hfiles 2023-07-24 18:08:12,327 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf/1c7e65bcf06d474ca8ca76098be01582 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,361 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. completed. 2023-07-24 18:08:12,361 DEBUG [rs(jenkins-hbase4.apache.org,34839,1690221975292)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:12,361 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:08:12,361 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:08:12,361 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,362 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 18:08:12,362 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34839,1690221975292' in zk 2023-07-24 18:08:12,363 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,363 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 18:08:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:12,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:12,364 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:12,364 DEBUG [member: 'jenkins-hbase4.apache.org,34839,1690221975292' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 18:08:12,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:12,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:12,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,371 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. completed. 2023-07-24 18:08:12,371 DEBUG [rs(jenkins-hbase4.apache.org,37319,1690221975353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:12,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,371 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 18:08:12,371 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 18:08:12,371 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,371 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 18:08:12,371 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37319,1690221975353' in zk 2023-07-24 18:08:12,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:12,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,373 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 18:08:12,373 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,373 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:12,373 DEBUG [member: 'jenkins-hbase4.apache.org,37319,1690221975353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 18:08:12,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,379 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:12,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34839,1690221975292': 2023-07-24 18:08:12,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34839,1690221975292' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 18:08:12,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:12,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:12,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:12,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:12,381 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 18:08:12,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:12,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:12,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37319,1690221975353': 2023-07-24 18:08:12,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37319,1690221975353' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 18:08:12,389 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 18:08:12,390 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 18:08:12,390 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 18:08:12,390 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,390 INFO [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 18:08:12,392 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,392 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:12,393 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:12,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:12,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 18:08:12,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 18:08:12,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:12,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:12,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:12,394 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 18:08:12,398 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,398 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 18:08:12,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 18:08:12,403 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,403 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,404 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:12,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:12,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 18:08:12,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:12,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:12,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 18:08:12,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 18:08:12,411 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:12,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:12,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,412 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,412 DEBUG [(jenkins-hbase4.apache.org,42435,1690221973837)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 18:08:12,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,414 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 18:08:12,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 18:08:12,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 18:08:12,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724646073017db94f259e177f0bc7c5ef8f, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ef2711edc5ac416b9281e5ba3e91f90c] mob files 2023-07-24 18:08:12,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724646073017db94f259e177f0bc7c5ef8f 2023-07-24 18:08:12,416 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ef2711edc5ac416b9281e5ba3e91f90c 2023-07-24 18:08:12,460 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:12,681 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:12,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:12,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 18:08:12,683 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 18:08:12,721 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0006_000001 (auth:SIMPLE) 2023-07-24 18:08:13,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 18:08:13,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:13,029 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:13,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690222092071Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690222092460 (+389 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690222092460Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690222092460Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690222092484 (+24 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690222092572 (+88 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690222093028 (+456 ms) 2023-07-24 18:08:13,032 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 18:08:13,034 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 958 msec 2023-07-24 18:08:13,183 DEBUG [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 18:08:13,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 18:08:13,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 18:08:13,184 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184 2023-07-24 18:08:13,184 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35665, tgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184, rawTgtDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184, srcFsUri=hdfs://localhost:35665, srcDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:08:13,209 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4 2023-07-24 18:08:13,209 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_674010616_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:13,209 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35665, inputRoot=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4, snapshotDir=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 18:08:13,228 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:13,249 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,250 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,250 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,251 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,251 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,252 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,252 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,331 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/hadoop-5662580135622454645.jar 2023-07-24 18:08:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,332 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,333 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,333 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 18:08:13,333 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 18:08:13,334 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 18:08:13,334 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 18:08:13,334 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 18:08:13,335 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 18:08:13,335 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 18:08:13,336 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 18:08:13,336 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 18:08:13,336 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 18:08:13,336 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 18:08:13,337 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:08:13,337 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:08:13,338 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:08:13,338 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:08:13,338 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 18:08:13,338 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:08:13,339 DEBUG [Listener at jenkins-hbase4.apache.org/36813] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 18:08:13,876 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:08:14,110 WARN [Listener at jenkins-hbase4.apache.org/36813] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 18:08:14,112 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 18:08:14,115 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 18:08:14,217 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:08:14,217 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 18:08:14,559 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0007_000001 (auth:SIMPLE) 2023-07-24 18:08:19,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0007_000001 (auth:SIMPLE) 2023-07-24 18:08:21,728 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0007_000001 (auth:SIMPLE) 2023-07-24 18:08:26,741 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0007_000001 (auth:SIMPLE) 2023-07-24 18:08:28,392 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 18:08:28,392 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 18:08:28,417 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,417 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 18:08:28,420 INFO [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 18:08:28,420 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,420 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 18:08:28,421 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 18:08:28,421 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-153284434_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,421 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 18:08:28,421 DEBUG [Listener at jenkins-hbase4.apache.org/36813] snapshot.TestExportSnapshot(367): hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/export-test/export-1690222093184/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 18:08:28,462 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,463 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 18:08:28,477 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222108476"}]},"ts":"1690222108476"} 2023-07-24 18:08:28,482 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 18:08:28,484 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 18:08:28,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, UNASSIGN}] 2023-07-24 18:08:28,487 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, UNASSIGN 2023-07-24 18:08:28,489 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, UNASSIGN 2023-07-24 18:08:28,490 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a6242d36d942569ee6c71af50b6ebfb0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:28,490 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222108490"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222108490"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222108490"}]},"ts":"1690222108490"} 2023-07-24 18:08:28,491 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c2e79c018c8f64e0ff14aad731cf2818, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:28,491 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222108491"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690222108491"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690222108491"}]},"ts":"1690222108491"} 2023-07-24 18:08:28,494 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure a6242d36d942569ee6c71af50b6ebfb0, server=jenkins-hbase4.apache.org,34839,1690221975292}] 2023-07-24 18:08:28,495 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure c2e79c018c8f64e0ff14aad731cf2818, server=jenkins-hbase4.apache.org,37319,1690221975353}] 2023-07-24 18:08:28,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 18:08:28,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:28,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c2e79c018c8f64e0ff14aad731cf2818, disabling compactions & flushes 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a6242d36d942569ee6c71af50b6ebfb0, disabling compactions & flushes 2023-07-24 18:08:28,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:28,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. after waiting 0 ms 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. after waiting 0 ms 2023-07-24 18:08:28,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:28,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:08:28,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:08:28,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:28,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0. 2023-07-24 18:08:28,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a6242d36d942569ee6c71af50b6ebfb0: 2023-07-24 18:08:28,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:28,702 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818. 2023-07-24 18:08:28,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c2e79c018c8f64e0ff14aad731cf2818: 2023-07-24 18:08:28,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:28,707 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=a6242d36d942569ee6c71af50b6ebfb0, regionState=CLOSED 2023-07-24 18:08:28,707 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222108706"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222108706"}]},"ts":"1690222108706"} 2023-07-24 18:08:28,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:28,708 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c2e79c018c8f64e0ff14aad731cf2818, regionState=CLOSED 2023-07-24 18:08:28,708 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690222108708"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690222108708"}]},"ts":"1690222108708"} 2023-07-24 18:08:28,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 18:08:28,710 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure a6242d36d942569ee6c71af50b6ebfb0, server=jenkins-hbase4.apache.org,34839,1690221975292 in 214 msec 2023-07-24 18:08:28,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 18:08:28,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure c2e79c018c8f64e0ff14aad731cf2818, server=jenkins-hbase4.apache.org,37319,1690221975353 in 214 msec 2023-07-24 18:08:28,712 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a6242d36d942569ee6c71af50b6ebfb0, UNASSIGN in 225 msec 2023-07-24 18:08:28,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 18:08:28,713 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c2e79c018c8f64e0ff14aad731cf2818, UNASSIGN in 227 msec 2023-07-24 18:08:28,714 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690222108714"}]},"ts":"1690222108714"} 2023-07-24 18:08:28,715 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 18:08:28,716 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 18:08:28,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 254 msec 2023-07-24 18:08:28,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 18:08:28,778 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 18:08:28,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,782 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,783 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,788 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42037] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,790 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:28,791 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:28,791 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,791 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,791 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,792 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 18:08:28,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 18:08:28,792 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 18:08:28,793 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 18:08:28,793 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,793 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:28,793 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,794 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:28,794 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,794 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:28,794 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,794 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 18:08:28,794 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/recovered.edits] 2023-07-24 18:08:28,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 18:08:28,795 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf, FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/recovered.edits] 2023-07-24 18:08:28,807 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf/1c7e65bcf06d474ca8ca76098be01582 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/cf/1c7e65bcf06d474ca8ca76098be01582 2023-07-24 18:08:28,807 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf/bf5e338367de4f6db54a08226f015913 to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/cf/bf5e338367de4f6db54a08226f015913 2023-07-24 18:08:28,811 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0/recovered.edits/9.seqid 2023-07-24 18:08:28,811 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/recovered.edits/9.seqid to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818/recovered.edits/9.seqid 2023-07-24 18:08:28,812 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a6242d36d942569ee6c71af50b6ebfb0 2023-07-24 18:08:28,812 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c2e79c018c8f64e0ff14aad731cf2818 2023-07-24 18:08:28,812 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 18:08:28,812 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 18:08:28,813 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 18:08:28,817 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724646073017db94f259e177f0bc7c5ef8f to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724646073017db94f259e177f0bc7c5ef8f 2023-07-24 18:08:28,818 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ef2711edc5ac416b9281e5ba3e91f90c to hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724ef2711edc5ac416b9281e5ba3e91f90c 2023-07-24 18:08:28,818 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 18:08:28,820 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,822 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 18:08:28,828 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 18:08:28,829 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,829 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 18:08:28,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222108829"}]},"ts":"9223372036854775807"} 2023-07-24 18:08:28,830 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690222108829"}]},"ts":"9223372036854775807"} 2023-07-24 18:08:28,835 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 18:08:28,835 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c2e79c018c8f64e0ff14aad731cf2818, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690222088608.c2e79c018c8f64e0ff14aad731cf2818.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a6242d36d942569ee6c71af50b6ebfb0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690222088608.a6242d36d942569ee6c71af50b6ebfb0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 18:08:28,835 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 18:08:28,835 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690222108835"}]},"ts":"9223372036854775807"} 2023-07-24 18:08:28,838 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 18:08:28,840 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,843 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 61 msec 2023-07-24 18:08:28,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 18:08:28,896 INFO [Listener at jenkins-hbase4.apache.org/36813] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 18:08:28,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 18:08:28,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,906 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 18:08:28,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42435] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 18:08:28,942 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 762) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563986759_1 at /127.0.0.1:39646 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (337744187) connection to jenkins-hbase4.apache.org/172.31.14.131:44999 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:60030 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5659 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1563986759_1 at /127.0.0.1:56574 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:56600 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-153284434_17 at /127.0.0.1:39662 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x265a1ba0-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 922), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=700 (was 676) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=3856 (was 4584) 2023-07-24 18:08:28,942 WARN [Listener at jenkins-hbase4.apache.org/36813] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-24 18:08:28,942 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 18:08:28,960 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 18:08:32,856 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690221983197_0007_000001 (auth:SIMPLE) 2023-07-24 18:08:34,293 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 18:08:43,089 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 18:08:57,212 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 18:08:57,212 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 18:08:57,328 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 18:08:57,345 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 18:08:57,347 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 18:08:57,369 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 18:08:57,474 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 18:08:57,474 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 18:08:57,474 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 18:08:57,474 INFO [Listener at jenkins-hbase4.apache.org/36813] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 18:08:57,474 DEBUG [Listener at jenkins-hbase4.apache.org/36813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x572c911d to 127.0.0.1:57118 2023-07-24 18:08:57,474 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,475 DEBUG [Listener at jenkins-hbase4.apache.org/36813] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 18:08:57,475 DEBUG [Listener at jenkins-hbase4.apache.org/36813] util.JVMClusterUtil(257): Found active master hash=875714014, stopped=false 2023-07-24 18:08:57,475 DEBUG [Listener at jenkins-hbase4.apache.org/36813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:57,475 DEBUG [Listener at jenkins-hbase4.apache.org/36813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 18:08:57,475 INFO [Listener at jenkins-hbase4.apache.org/36813] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:08:57,477 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 18:08:57,477 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 18:08:57,477 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:08:57,477 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 18:08:57,477 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 18:08:57,477 INFO [Listener at jenkins-hbase4.apache.org/36813] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 18:08:57,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:08:57,477 DEBUG [Listener at jenkins-hbase4.apache.org/36813] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x68a64892 to 127.0.0.1:57118 2023-07-24 18:08:57,477 DEBUG [Listener at jenkins-hbase4.apache.org/36813] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,477 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:08:57,477 INFO [Listener at jenkins-hbase4.apache.org/36813] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34839,1690221975292' ***** 2023-07-24 18:08:57,478 DEBUG [Listener at jenkins-hbase4.apache.org/36813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:57,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:08:57,478 INFO [Listener at jenkins-hbase4.apache.org/36813] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 18:08:57,478 INFO [Listener at jenkins-hbase4.apache.org/36813] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37319,1690221975353' ***** 2023-07-24 18:08:57,478 DEBUG [Listener at jenkins-hbase4.apache.org/36813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:57,478 INFO [RS:0;jenkins-hbase4:34839] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 18:08:57,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 18:08:57,478 INFO [Listener at jenkins-hbase4.apache.org/36813] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 18:08:57,478 INFO [Listener at jenkins-hbase4.apache.org/36813] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42037,1690221975401' ***** 2023-07-24 18:08:57,478 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 18:08:57,478 DEBUG [Listener at jenkins-hbase4.apache.org/36813] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:57,478 INFO [RS:0;jenkins-hbase4:34839] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 18:08:57,479 INFO [RS:1;jenkins-hbase4:37319] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 18:08:57,479 INFO [Listener at jenkins-hbase4.apache.org/36813] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 18:08:57,479 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 18:08:57,479 INFO [RS:1;jenkins-hbase4:37319] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 18:08:57,479 INFO [RS:1;jenkins-hbase4:37319] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 18:08:57,479 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:57,479 DEBUG [RS:1;jenkins-hbase4:37319] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3977459d to 127.0.0.1:57118 2023-07-24 18:08:57,479 DEBUG [RS:1;jenkins-hbase4:37319] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,479 INFO [RS:0;jenkins-hbase4:34839] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 18:08:57,479 INFO [RS:2;jenkins-hbase4:42037] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 18:08:57,481 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37319,1690221975353; all regions closed. 2023-07-24 18:08:57,481 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 18:08:57,481 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:57,481 INFO [RS:2;jenkins-hbase4:42037] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 18:08:57,481 DEBUG [RS:0;jenkins-hbase4:34839] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x79f1a985 to 127.0.0.1:57118 2023-07-24 18:08:57,481 INFO [RS:2;jenkins-hbase4:42037] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 18:08:57,481 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,483 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34839,1690221975292; all regions closed. 2023-07-24 18:08:57,483 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(3305): Received CLOSE for 66da5a695a64d1bbf76e8ecddb18ae4b 2023-07-24 18:08:57,483 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(3305): Received CLOSE for 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:08:57,483 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:57,483 DEBUG [RS:2;jenkins-hbase4:42037] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x61706be8 to 127.0.0.1:57118 2023-07-24 18:08:57,484 DEBUG [RS:2;jenkins-hbase4:42037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 66da5a695a64d1bbf76e8ecddb18ae4b, disabling compactions & flushes 2023-07-24 18:08:57,484 INFO [RS:2;jenkins-hbase4:42037] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 18:08:57,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:08:57,484 INFO [RS:2;jenkins-hbase4:42037] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 18:08:57,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:08:57,484 INFO [RS:2;jenkins-hbase4:42037] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 18:08:57,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. after waiting 0 ms 2023-07-24 18:08:57,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:08:57,484 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 18:08:57,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 66da5a695a64d1bbf76e8ecddb18ae4b 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 18:08:57,485 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1474): Waiting on 3 regions to close 2023-07-24 18:08:57,485 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1478): Online Regions={66da5a695a64d1bbf76e8ecddb18ae4b=hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b., 1588230740=hbase:meta,,1.1588230740, 91c2d61de8df837bf185c431ca87d6a9=hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9.} 2023-07-24 18:08:57,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 18:08:57,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 18:08:57,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 18:08:57,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 18:08:57,486 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 18:08:57,487 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 18:08:57,487 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1504): Waiting on 1588230740, 66da5a695a64d1bbf76e8ecddb18ae4b, 91c2d61de8df837bf185c431ca87d6a9 2023-07-24 18:08:57,500 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 18:08:57,504 DEBUG [RS:1;jenkins-hbase4:37319] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs 2023-07-24 18:08:57,504 DEBUG [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs 2023-07-24 18:08:57,504 INFO [RS:0;jenkins-hbase4:34839] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34839%2C1690221975292:(num 1690221977628) 2023-07-24 18:08:57,504 INFO [RS:1;jenkins-hbase4:37319] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37319%2C1690221975353:(num 1690221977629) 2023-07-24 18:08:57,504 DEBUG [RS:1;jenkins-hbase4:37319] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,504 DEBUG [RS:0;jenkins-hbase4:34839] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:57,504 INFO [RS:1;jenkins-hbase4:37319] regionserver.LeaseManager(133): Closed leases 2023-07-24 18:08:57,504 INFO [RS:0;jenkins-hbase4:34839] regionserver.LeaseManager(133): Closed leases 2023-07-24 18:08:57,508 INFO [RS:1;jenkins-hbase4:37319] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 18:08:57,508 INFO [RS:0;jenkins-hbase4:34839] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 18:08:57,509 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 18:08:57,509 INFO [RS:1;jenkins-hbase4:37319] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 18:08:57,509 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 18:08:57,509 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 18:08:57,509 INFO [RS:1;jenkins-hbase4:37319] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 18:08:57,510 INFO [RS:1;jenkins-hbase4:37319] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 18:08:57,509 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 18:08:57,510 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 18:08:57,510 INFO [RS:0;jenkins-hbase4:34839] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 18:08:57,511 INFO [RS:1;jenkins-hbase4:37319] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37319 2023-07-24 18:08:57,515 INFO [RS:0;jenkins-hbase4:34839] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34839 2023-07-24 18:08:57,519 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:57,519 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34839,1690221975292 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:57,519 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:57,520 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37319,1690221975353 2023-07-24 18:08:57,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/.tmp/info/a9ddc23988b34c4aa38047d2e6173841 2023-07-24 18:08:57,523 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34839,1690221975292] 2023-07-24 18:08:57,524 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34839,1690221975292; numProcessing=1 2023-07-24 18:08:57,525 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34839,1690221975292 already deleted, retry=false 2023-07-24 18:08:57,525 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34839,1690221975292 expired; onlineServers=2 2023-07-24 18:08:57,526 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37319,1690221975353] 2023-07-24 18:08:57,526 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37319,1690221975353; numProcessing=2 2023-07-24 18:08:57,527 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37319,1690221975353 already deleted, retry=false 2023-07-24 18:08:57,527 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37319,1690221975353 expired; onlineServers=1 2023-07-24 18:08:57,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/.tmp/info/a9ddc23988b34c4aa38047d2e6173841 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/info/a9ddc23988b34c4aa38047d2e6173841 2023-07-24 18:08:57,535 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/info/a9ddc23988b34c4aa38047d2e6173841, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 18:08:57,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 66da5a695a64d1bbf76e8ecddb18ae4b in 52ms, sequenceid=6, compaction requested=false 2023-07-24 18:08:57,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/namespace/66da5a695a64d1bbf76e8ecddb18ae4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 18:08:57,541 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:57,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:08:57,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 66da5a695a64d1bbf76e8ecddb18ae4b: 2023-07-24 18:08:57,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690221978188.66da5a695a64d1bbf76e8ecddb18ae4b. 2023-07-24 18:08:57,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 91c2d61de8df837bf185c431ca87d6a9, disabling compactions & flushes 2023-07-24 18:08:57,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:08:57,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:08:57,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. after waiting 0 ms 2023-07-24 18:08:57,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:08:57,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 91c2d61de8df837bf185c431ca87d6a9 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 18:08:57,551 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 18:08:57,555 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/.tmp/l/1d7f5713ad944e8a8c9658ed3483f3a6 2023-07-24 18:08:57,559 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d7f5713ad944e8a8c9658ed3483f3a6 2023-07-24 18:08:57,560 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/.tmp/l/1d7f5713ad944e8a8c9658ed3483f3a6 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/l/1d7f5713ad944e8a8c9658ed3483f3a6 2023-07-24 18:08:57,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1d7f5713ad944e8a8c9658ed3483f3a6 2023-07-24 18:08:57,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/l/1d7f5713ad944e8a8c9658ed3483f3a6, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 18:08:57,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 91c2d61de8df837bf185c431ca87d6a9 in 29ms, sequenceid=18, compaction requested=false 2023-07-24 18:08:57,586 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/acl/91c2d61de8df837bf185c431ca87d6a9/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 18:08:57,587 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:57,588 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:08:57,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 91c2d61de8df837bf185c431ca87d6a9: 2023-07-24 18:08:57,588 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690221978921.91c2d61de8df837bf185c431ca87d6a9. 2023-07-24 18:08:57,622 INFO [RS:0;jenkins-hbase4:34839] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34839,1690221975292; zookeeper connection closed. 2023-07-24 18:08:57,622 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:57,622 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:34839-0x101988310a50001, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:57,623 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6872e0d9] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6872e0d9 2023-07-24 18:08:57,687 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 18:08:57,722 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:57,722 INFO [RS:1;jenkins-hbase4:37319] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37319,1690221975353; zookeeper connection closed. 2023-07-24 18:08:57,722 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:37319-0x101988310a50002, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:57,723 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4628de2a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4628de2a 2023-07-24 18:08:57,888 DEBUG [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 18:08:57,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/.tmp/info/9bb5aaf32e404de3860dd31e0aa92bad 2023-07-24 18:08:57,929 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bb5aaf32e404de3860dd31e0aa92bad 2023-07-24 18:08:57,938 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/.tmp/rep_barrier/7b728be50fce4d7baff5ecba580b95b3 2023-07-24 18:08:57,943 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b728be50fce4d7baff5ecba580b95b3 2023-07-24 18:08:57,961 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/.tmp/table/eca39be7e31b4f1fb897fd159807f890 2023-07-24 18:08:57,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eca39be7e31b4f1fb897fd159807f890 2023-07-24 18:08:57,967 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/.tmp/info/9bb5aaf32e404de3860dd31e0aa92bad as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/info/9bb5aaf32e404de3860dd31e0aa92bad 2023-07-24 18:08:57,972 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bb5aaf32e404de3860dd31e0aa92bad 2023-07-24 18:08:57,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/info/9bb5aaf32e404de3860dd31e0aa92bad, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 18:08:57,973 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/.tmp/rep_barrier/7b728be50fce4d7baff5ecba580b95b3 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/rep_barrier/7b728be50fce4d7baff5ecba580b95b3 2023-07-24 18:08:57,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7b728be50fce4d7baff5ecba580b95b3 2023-07-24 18:08:57,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/rep_barrier/7b728be50fce4d7baff5ecba580b95b3, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 18:08:57,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/.tmp/table/eca39be7e31b4f1fb897fd159807f890 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/table/eca39be7e31b4f1fb897fd159807f890 2023-07-24 18:08:57,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eca39be7e31b4f1fb897fd159807f890 2023-07-24 18:08:57,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/table/eca39be7e31b4f1fb897fd159807f890, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 18:08:57,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 504ms, sequenceid=131, compaction requested=false 2023-07-24 18:08:58,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 18:08:58,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 18:08:58,007 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 18:08:58,008 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 18:08:58,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 18:08:58,008 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 18:08:58,088 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42037,1690221975401; all regions closed. 2023-07-24 18:08:58,093 DEBUG [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs 2023-07-24 18:08:58,093 INFO [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42037%2C1690221975401.meta:.meta(num 1690221977851) 2023-07-24 18:08:58,100 DEBUG [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/oldWALs 2023-07-24 18:08:58,100 INFO [RS:2;jenkins-hbase4:42037] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42037%2C1690221975401:(num 1690221977629) 2023-07-24 18:08:58,100 DEBUG [RS:2;jenkins-hbase4:42037] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:58,100 INFO [RS:2;jenkins-hbase4:42037] regionserver.LeaseManager(133): Closed leases 2023-07-24 18:08:58,101 INFO [RS:2;jenkins-hbase4:42037] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 18:08:58,101 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 18:08:58,101 INFO [RS:2;jenkins-hbase4:42037] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42037 2023-07-24 18:08:58,103 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42037,1690221975401 2023-07-24 18:08:58,103 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 18:08:58,106 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42037,1690221975401] 2023-07-24 18:08:58,106 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42037,1690221975401; numProcessing=3 2023-07-24 18:08:58,107 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42037,1690221975401 already deleted, retry=false 2023-07-24 18:08:58,107 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42037,1690221975401 expired; onlineServers=0 2023-07-24 18:08:58,107 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42435,1690221973837' ***** 2023-07-24 18:08:58,107 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 18:08:58,107 DEBUG [M:0;jenkins-hbase4:42435] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@750f5fe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 18:08:58,107 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42435,1690221973837 2023-07-24 18:08:58,107 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42435,1690221973837; all regions closed. 2023-07-24 18:08:58,107 DEBUG [M:0;jenkins-hbase4:42435] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 18:08:58,108 DEBUG [M:0;jenkins-hbase4:42435] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 18:08:58,108 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 18:08:58,108 DEBUG [M:0;jenkins-hbase4:42435] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 18:08:58,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690221977099] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690221977099,5,FailOnTimeoutGroup] 2023-07-24 18:08:58,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690221977098] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690221977098,5,FailOnTimeoutGroup] 2023-07-24 18:08:58,108 INFO [M:0;jenkins-hbase4:42435] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 18:08:58,108 INFO [M:0;jenkins-hbase4:42435] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 18:08:58,108 INFO [M:0;jenkins-hbase4:42435] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 18:08:58,108 DEBUG [M:0;jenkins-hbase4:42435] master.HMaster(1512): Stopping service threads 2023-07-24 18:08:58,108 INFO [M:0;jenkins-hbase4:42435] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 18:08:58,109 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 18:08:58,109 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 18:08:58,109 ERROR [M:0;jenkins-hbase4:42435] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 18:08:58,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 18:08:58,109 INFO [M:0;jenkins-hbase4:42435] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 18:08:58,110 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 18:08:58,110 DEBUG [M:0;jenkins-hbase4:42435] zookeeper.ZKUtil(398): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 18:08:58,110 WARN [M:0;jenkins-hbase4:42435] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 18:08:58,110 INFO [M:0;jenkins-hbase4:42435] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 18:08:58,110 INFO [M:0;jenkins-hbase4:42435] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 18:08:58,111 DEBUG [M:0;jenkins-hbase4:42435] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 18:08:58,111 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:08:58,111 DEBUG [M:0;jenkins-hbase4:42435] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:08:58,111 DEBUG [M:0;jenkins-hbase4:42435] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 18:08:58,111 DEBUG [M:0;jenkins-hbase4:42435] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:08:58,111 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.85 KB 2023-07-24 18:08:58,126 INFO [M:0;jenkins-hbase4:42435] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6627616170744c70b7bbb072b4e214a9 2023-07-24 18:08:58,130 INFO [M:0;jenkins-hbase4:42435] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6627616170744c70b7bbb072b4e214a9 2023-07-24 18:08:58,131 DEBUG [M:0;jenkins-hbase4:42435] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6627616170744c70b7bbb072b4e214a9 as hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6627616170744c70b7bbb072b4e214a9 2023-07-24 18:08:58,135 INFO [M:0;jenkins-hbase4:42435] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6627616170744c70b7bbb072b4e214a9 2023-07-24 18:08:58,135 INFO [M:0;jenkins-hbase4:42435] regionserver.HStore(1080): Added hdfs://localhost:35665/user/jenkins/test-data/599d2f29-3807-f078-d59d-c6cb2729efd4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6627616170744c70b7bbb072b4e214a9, entries=119, sequenceid=899, filesize=28.6 K 2023-07-24 18:08:58,136 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384662, heapSize ~451.84 KB/462680, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-07-24 18:08:58,137 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 18:08:58,137 DEBUG [M:0;jenkins-hbase4:42435] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 18:08:58,143 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 18:08:58,143 INFO [M:0;jenkins-hbase4:42435] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 18:08:58,144 INFO [M:0;jenkins-hbase4:42435] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42435 2023-07-24 18:08:58,146 DEBUG [M:0;jenkins-hbase4:42435] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42435,1690221973837 already deleted, retry=false 2023-07-24 18:08:58,206 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:58,206 INFO [RS:2;jenkins-hbase4:42037] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42037,1690221975401; zookeeper connection closed. 2023-07-24 18:08:58,206 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): regionserver:42037-0x101988310a50003, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:58,206 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5e535d00] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5e535d00 2023-07-24 18:08:58,207 INFO [Listener at jenkins-hbase4.apache.org/36813] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 18:08:58,306 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:58,306 INFO [M:0;jenkins-hbase4:42435] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42435,1690221973837; zookeeper connection closed. 2023-07-24 18:08:58,306 DEBUG [Listener at localhost/42851-EventThread] zookeeper.ZKWatcher(600): master:42435-0x101988310a50000, quorum=127.0.0.1:57118, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 18:08:58,309 WARN [Listener at jenkins-hbase4.apache.org/36813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 18:08:58,313 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 18:08:58,418 WARN [BP-1496843663-172.31.14.131-1690221969875 heartbeating to localhost/127.0.0.1:35665] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 18:08:58,418 WARN [BP-1496843663-172.31.14.131-1690221969875 heartbeating to localhost/127.0.0.1:35665] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1496843663-172.31.14.131-1690221969875 (Datanode Uuid 78552ce0-280d-4e04-95c6-61ad13d13b69) service to localhost/127.0.0.1:35665 2023-07-24 18:08:58,420 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data5/current/BP-1496843663-172.31.14.131-1690221969875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 18:08:58,420 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data6/current/BP-1496843663-172.31.14.131-1690221969875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 18:08:58,422 WARN [Listener at jenkins-hbase4.apache.org/36813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 18:08:58,426 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 18:08:58,430 WARN [BP-1496843663-172.31.14.131-1690221969875 heartbeating to localhost/127.0.0.1:35665] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 18:08:58,430 WARN [BP-1496843663-172.31.14.131-1690221969875 heartbeating to localhost/127.0.0.1:35665] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1496843663-172.31.14.131-1690221969875 (Datanode Uuid 04b89a8d-76e4-475f-b19a-715666c2db2d) service to localhost/127.0.0.1:35665 2023-07-24 18:08:58,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data3/current/BP-1496843663-172.31.14.131-1690221969875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 18:08:58,432 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data4/current/BP-1496843663-172.31.14.131-1690221969875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 18:08:58,438 WARN [Listener at jenkins-hbase4.apache.org/36813] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 18:08:58,440 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 18:08:58,544 WARN [BP-1496843663-172.31.14.131-1690221969875 heartbeating to localhost/127.0.0.1:35665] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 18:08:58,544 WARN [BP-1496843663-172.31.14.131-1690221969875 heartbeating to localhost/127.0.0.1:35665] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1496843663-172.31.14.131-1690221969875 (Datanode Uuid 50a11137-d846-4cf0-a508-ad6fe2ab09cb) service to localhost/127.0.0.1:35665 2023-07-24 18:08:58,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data1/current/BP-1496843663-172.31.14.131-1690221969875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 18:08:58,545 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/00f52924-8dae-5c48-bafe-aa8b6f8d12ab/cluster_451a5138-8c59-07c0-6d4b-6506b49b3135/dfs/data/data2/current/BP-1496843663-172.31.14.131-1690221969875] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 18:08:58,578 INFO [Listener at jenkins-hbase4.apache.org/36813] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 18:08:58,614 INFO [Listener at jenkins-hbase4.apache.org/36813] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 18:08:58,711 INFO [Listener at jenkins-hbase4.apache.org/36813] hbase.HBaseTestingUtility(1293): Minicluster is down