2023-09-19 19:01:08,590 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-19 19:01:08,819 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3 2023-09-19 19:01:08,819 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-19 19:01:08,819 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-19 19:01:08,859 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-19 19:01:09,111 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-19 19:01:09,112 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a, deleteOnExit=true 2023-09-19 19:01:09,112 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-19 19:01:09,112 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/test.cache.data in system properties and HBase conf 2023-09-19 19:01:09,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop.tmp.dir in system properties and HBase conf 2023-09-19 19:01:09,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop.log.dir in system properties and HBase conf 2023-09-19 19:01:09,113 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-19 19:01:09,114 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-19 19:01:09,114 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-19 19:01:09,446 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-19 19:01:09,451 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-19 19:01:09,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-19 19:01:09,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-19 19:01:09,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 19:01:09,452 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-19 19:01:09,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-19 19:01:09,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 19:01:09,453 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 19:01:09,454 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-19 19:01:09,454 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/nfs.dump.dir in system properties and HBase conf 2023-09-19 19:01:09,455 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir in system properties and HBase conf 2023-09-19 19:01:09,455 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 19:01:09,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-19 19:01:09,456 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-19 19:01:09,995 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-19 19:01:10,000 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-19 19:01:10,309 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-19 19:01:10,474 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-19 19:01:10,488 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:10,526 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:10,562 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_localhost_33809_hdfs____.orzxx1/webapp 2023-09-19 19:01:10,723 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33809 2023-09-19 19:01:10,735 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-19 19:01:10,735 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-19 19:01:11,253 WARN [Listener at localhost/37439] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 19:01:11,332 WARN [Listener at localhost/37439] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 19:01:11,354 WARN [Listener at localhost/37439] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:11,410 INFO [Listener at localhost/37439] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:11,416 INFO [Listener at localhost/37439] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_localhost_37401_datanode____qj4tko/webapp 2023-09-19 19:01:11,513 INFO [Listener at localhost/37439] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37401 2023-09-19 19:01:11,927 WARN [Listener at localhost/35667] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 19:01:11,946 WARN [Listener at localhost/35667] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 19:01:11,950 WARN [Listener at localhost/35667] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:11,952 INFO [Listener at localhost/35667] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:11,962 INFO [Listener at localhost/35667] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_localhost_37243_datanode____4jry5w/webapp 2023-09-19 19:01:12,061 INFO [Listener at localhost/35667] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37243 2023-09-19 19:01:12,073 WARN [Listener at localhost/35793] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 19:01:12,090 WARN [Listener at localhost/35793] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-19 19:01:12,093 WARN [Listener at localhost/35793] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:12,094 INFO [Listener at localhost/35793] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:12,102 INFO [Listener at localhost/35793] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_localhost_46643_datanode____.6yj8yu/webapp 2023-09-19 19:01:12,220 INFO [Listener at localhost/35793] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46643 2023-09-19 19:01:12,233 WARN [Listener at localhost/35845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-19 19:01:12,527 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x207f70f320b3dea1: Processing first storage report for DS-7b27dabd-963c-402e-9735-9969468290da from datanode 6d627659-1c4c-4008-8749-ad214a8d1d6b 2023-09-19 19:01:12,529 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x207f70f320b3dea1: from storage DS-7b27dabd-963c-402e-9735-9969468290da node DatanodeRegistration(127.0.0.1:40645, datanodeUuid=6d627659-1c4c-4008-8749-ad214a8d1d6b, infoPort=43663, infoSecurePort=0, ipcPort=35667, storageInfo=lv=-57;cid=testClusterID;nsid=1696879332;c=1695150070084), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-19 19:01:12,529 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5579b79698993e2: Processing first storage report for DS-a23e4cef-084d-4204-9b49-ccc9005882b0 from datanode 3b395402-8293-4090-902a-b51910be1780 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5579b79698993e2: from storage DS-a23e4cef-084d-4204-9b49-ccc9005882b0 node DatanodeRegistration(127.0.0.1:40785, datanodeUuid=3b395402-8293-4090-902a-b51910be1780, infoPort=36463, infoSecurePort=0, ipcPort=35793, storageInfo=lv=-57;cid=testClusterID;nsid=1696879332;c=1695150070084), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfcf682d917ddf0cc: Processing first storage report for DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9 from datanode d9b60c53-3990-4b29-be7e-5c8ffc02819c 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfcf682d917ddf0cc: from storage DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9 node DatanodeRegistration(127.0.0.1:44535, datanodeUuid=d9b60c53-3990-4b29-be7e-5c8ffc02819c, infoPort=33275, infoSecurePort=0, ipcPort=35845, storageInfo=lv=-57;cid=testClusterID;nsid=1696879332;c=1695150070084), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x207f70f320b3dea1: Processing first storage report for DS-709fa001-448b-4115-9e89-7abf4230edf8 from datanode 6d627659-1c4c-4008-8749-ad214a8d1d6b 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x207f70f320b3dea1: from storage DS-709fa001-448b-4115-9e89-7abf4230edf8 node DatanodeRegistration(127.0.0.1:40645, datanodeUuid=6d627659-1c4c-4008-8749-ad214a8d1d6b, infoPort=43663, infoSecurePort=0, ipcPort=35667, storageInfo=lv=-57;cid=testClusterID;nsid=1696879332;c=1695150070084), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb5579b79698993e2: Processing first storage report for DS-f1603b60-536e-4ae1-94a6-d44349034ab8 from datanode 3b395402-8293-4090-902a-b51910be1780 2023-09-19 19:01:12,530 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb5579b79698993e2: from storage DS-f1603b60-536e-4ae1-94a6-d44349034ab8 node DatanodeRegistration(127.0.0.1:40785, datanodeUuid=3b395402-8293-4090-902a-b51910be1780, infoPort=36463, infoSecurePort=0, ipcPort=35793, storageInfo=lv=-57;cid=testClusterID;nsid=1696879332;c=1695150070084), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 19:01:12,531 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfcf682d917ddf0cc: Processing first storage report for DS-5b4218a2-7e24-43b6-861d-6d0ee99917cc from datanode d9b60c53-3990-4b29-be7e-5c8ffc02819c 2023-09-19 19:01:12,531 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfcf682d917ddf0cc: from storage DS-5b4218a2-7e24-43b6-861d-6d0ee99917cc node DatanodeRegistration(127.0.0.1:44535, datanodeUuid=d9b60c53-3990-4b29-be7e-5c8ffc02819c, infoPort=33275, infoSecurePort=0, ipcPort=35845, storageInfo=lv=-57;cid=testClusterID;nsid=1696879332;c=1695150070084), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-19 19:01:12,745 DEBUG [Listener at localhost/35845] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3 2023-09-19 19:01:12,838 INFO [Listener at localhost/35845] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/zookeeper_0, clientPort=56787, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-19 19:01:12,858 INFO [Listener at localhost/35845] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56787 2023-09-19 19:01:12,866 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:12,868 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:13,578 INFO [Listener at localhost/35845] util.FSUtils(471): Created version file at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 with version=8 2023-09-19 19:01:13,578 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/hbase-staging 2023-09-19 19:01:13,966 INFO [Listener at localhost/35845] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-19 19:01:14,464 INFO [Listener at localhost/35845] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 19:01:14,497 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:14,498 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:14,498 INFO [Listener at localhost/35845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 19:01:14,499 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:14,499 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 19:01:14,647 INFO [Listener at localhost/35845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 19:01:14,724 DEBUG [Listener at localhost/35845] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-19 19:01:14,821 INFO [Listener at localhost/35845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33343 2023-09-19 19:01:14,834 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:14,837 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:14,862 INFO [Listener at localhost/35845] zookeeper.RecoverableZooKeeper(93): Process identifier=master:33343 connecting to ZooKeeper ensemble=127.0.0.1:56787 2023-09-19 19:01:14,921 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:333430x0, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 19:01:14,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:33343-0x100c5909b960000 connected 2023-09-19 19:01:14,961 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 19:01:14,962 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:01:14,975 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 19:01:14,986 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33343 2023-09-19 19:01:14,987 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33343 2023-09-19 19:01:14,987 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33343 2023-09-19 19:01:14,988 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33343 2023-09-19 19:01:14,988 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33343 2023-09-19 19:01:14,997 INFO [Listener at localhost/35845] master.HMaster(444): hbase.rootdir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, hbase.cluster.distributed=false 2023-09-19 19:01:15,068 INFO [Listener at localhost/35845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 19:01:15,068 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,068 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,068 INFO [Listener at localhost/35845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 19:01:15,068 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,068 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 19:01:15,073 INFO [Listener at localhost/35845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 19:01:15,076 INFO [Listener at localhost/35845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43479 2023-09-19 19:01:15,079 INFO [Listener at localhost/35845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 19:01:15,086 INFO [Listener at localhost/35845] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 19:01:15,087 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,090 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,093 INFO [Listener at localhost/35845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43479 connecting to ZooKeeper ensemble=127.0.0.1:56787 2023-09-19 19:01:15,097 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:434790x0, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 19:01:15,098 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43479-0x100c5909b960001 connected 2023-09-19 19:01:15,099 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 19:01:15,100 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:01:15,101 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 19:01:15,101 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43479 2023-09-19 19:01:15,102 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43479 2023-09-19 19:01:15,102 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43479 2023-09-19 19:01:15,102 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43479 2023-09-19 19:01:15,103 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43479 2023-09-19 19:01:15,116 INFO [Listener at localhost/35845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 19:01:15,116 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,116 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,117 INFO [Listener at localhost/35845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 19:01:15,117 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,117 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 19:01:15,117 INFO [Listener at localhost/35845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 19:01:15,119 INFO [Listener at localhost/35845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39869 2023-09-19 19:01:15,120 INFO [Listener at localhost/35845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 19:01:15,121 INFO [Listener at localhost/35845] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 19:01:15,122 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,124 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,126 INFO [Listener at localhost/35845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39869 connecting to ZooKeeper ensemble=127.0.0.1:56787 2023-09-19 19:01:15,129 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:398690x0, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 19:01:15,131 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39869-0x100c5909b960002 connected 2023-09-19 19:01:15,131 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 19:01:15,132 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:01:15,133 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 19:01:15,133 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39869 2023-09-19 19:01:15,134 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39869 2023-09-19 19:01:15,137 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39869 2023-09-19 19:01:15,137 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39869 2023-09-19 19:01:15,141 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39869 2023-09-19 19:01:15,160 INFO [Listener at localhost/35845] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-19 19:01:15,160 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,160 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,161 INFO [Listener at localhost/35845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-19 19:01:15,161 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-19 19:01:15,161 INFO [Listener at localhost/35845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-19 19:01:15,161 INFO [Listener at localhost/35845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-19 19:01:15,163 INFO [Listener at localhost/35845] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42277 2023-09-19 19:01:15,164 INFO [Listener at localhost/35845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-19 19:01:15,165 INFO [Listener at localhost/35845] mob.MobFileCache(124): MobFileCache disabled 2023-09-19 19:01:15,166 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,168 INFO [Listener at localhost/35845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,170 INFO [Listener at localhost/35845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42277 connecting to ZooKeeper ensemble=127.0.0.1:56787 2023-09-19 19:01:15,174 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:422770x0, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-19 19:01:15,175 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42277-0x100c5909b960003 connected 2023-09-19 19:01:15,175 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 19:01:15,176 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:01:15,177 DEBUG [Listener at localhost/35845] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-19 19:01:15,180 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42277 2023-09-19 19:01:15,180 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42277 2023-09-19 19:01:15,180 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42277 2023-09-19 19:01:15,181 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42277 2023-09-19 19:01:15,183 DEBUG [Listener at localhost/35845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42277 2023-09-19 19:01:15,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:15,195 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-19 19:01:15,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:15,216 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 19:01:15,216 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 19:01:15,216 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 19:01:15,217 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:15,216 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-19 19:01:15,218 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-19 19:01:15,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,33343,1695150073780 from backup master directory 2023-09-19 19:01:15,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-19 19:01:15,224 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:15,224 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-19 19:01:15,225 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 19:01:15,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:15,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-19 19:01:15,230 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-19 19:01:15,333 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/hbase.id with ID: c6fdc33b-0a1a-4d8c-be06-7c2015bb00a1 2023-09-19 19:01:15,375 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-19 19:01:15,393 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:15,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5922cdf5 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:15,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e903f5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:15,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-19 19:01:15,514 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-19 19:01:15,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-19 19:01:15,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-19 19:01:15,535 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-19 19:01:15,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-19 19:01:15,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 19:01:15,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store-tmp 2023-09-19 19:01:15,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:15,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-19 19:01:15,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:01:15,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:01:15,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-19 19:01:15,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:01:15,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:01:15,619 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 19:01:15,621 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/WALs/jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:15,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33343%2C1695150073780, suffix=, logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/WALs/jenkins-hbase4.apache.org,33343,1695150073780, archiveDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/oldWALs, maxLogs=10 2023-09-19 19:01:15,705 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK] 2023-09-19 19:01:15,705 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK] 2023-09-19 19:01:15,705 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK] 2023-09-19 19:01:15,715 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-19 19:01:15,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/WALs/jenkins-hbase4.apache.org,33343,1695150073780/jenkins-hbase4.apache.org%2C33343%2C1695150073780.1695150075658 2023-09-19 19:01:15,785 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK], DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK], DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK]] 2023-09-19 19:01:15,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-19 19:01:15,786 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:15,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 19:01:15,791 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 19:01:15,854 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-19 19:01:15,861 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-19 19:01:15,889 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-19 19:01:15,902 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:15,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-19 19:01:15,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-19 19:01:15,926 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-19 19:01:15,930 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:15,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69072447, jitterRate=0.029259666800498962}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:15,931 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 19:01:15,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-19 19:01:15,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-19 19:01:15,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-19 19:01:15,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-19 19:01:15,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-19 19:01:15,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-09-19 19:01:15,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-19 19:01:16,032 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-19 19:01:16,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-19 19:01:16,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-19 19:01:16,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-19 19:01:16,070 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-19 19:01:16,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-19 19:01:16,080 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-19 19:01:16,083 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:16,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-19 19:01:16,086 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-19 19:01:16,102 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-19 19:01:16,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 19:01:16,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 19:01:16,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 19:01:16,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-19 19:01:16,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:16,108 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,33343,1695150073780, sessionid=0x100c5909b960000, setting cluster-up flag (Was=false) 2023-09-19 19:01:16,127 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:16,133 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-19 19:01:16,135 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:16,143 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:16,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-19 19:01:16,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:16,154 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp 2023-09-19 19:01:16,187 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(951): ClusterId : c6fdc33b-0a1a-4d8c-be06-7c2015bb00a1 2023-09-19 19:01:16,187 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(951): ClusterId : c6fdc33b-0a1a-4d8c-be06-7c2015bb00a1 2023-09-19 19:01:16,187 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(951): ClusterId : c6fdc33b-0a1a-4d8c-be06-7c2015bb00a1 2023-09-19 19:01:16,196 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 19:01:16,196 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 19:01:16,196 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-19 19:01:16,204 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 19:01:16,204 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 19:01:16,204 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-19 19:01:16,204 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 19:01:16,204 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 19:01:16,204 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-19 19:01:16,209 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 19:01:16,209 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 19:01:16,209 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-19 19:01:16,212 DEBUG [RS:0;jenkins-hbase4:43479] zookeeper.ReadOnlyZKClient(139): Connect 0x7dad7058 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:16,214 DEBUG [RS:2;jenkins-hbase4:42277] zookeeper.ReadOnlyZKClient(139): Connect 0x2ba88a3d to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:16,214 DEBUG [RS:1;jenkins-hbase4:39869] zookeeper.ReadOnlyZKClient(139): Connect 0x1a0467bd to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:16,225 DEBUG [RS:2;jenkins-hbase4:42277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@256f6138, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:16,226 DEBUG [RS:0;jenkins-hbase4:43479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@736a819d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:16,226 DEBUG [RS:2;jenkins-hbase4:42277] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2150e14d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 19:01:16,226 DEBUG [RS:1;jenkins-hbase4:39869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14c39a8d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:16,226 DEBUG [RS:0;jenkins-hbase4:43479] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77551b28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 19:01:16,226 DEBUG [RS:1;jenkins-hbase4:39869] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10fc0ccd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 19:01:16,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-19 19:01:16,259 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:42277 2023-09-19 19:01:16,259 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39869 2023-09-19 19:01:16,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:16,262 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:43479 2023-09-19 19:01:16,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-19 19:01:16,264 INFO [RS:1;jenkins-hbase4:39869] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 19:01:16,264 INFO [RS:0;jenkins-hbase4:43479] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 19:01:16,265 INFO [RS:0;jenkins-hbase4:43479] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 19:01:16,264 INFO [RS:2;jenkins-hbase4:42277] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-19 19:01:16,265 INFO [RS:1;jenkins-hbase4:39869] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 19:01:16,265 INFO [RS:2;jenkins-hbase4:42277] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-19 19:01:16,265 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 19:01:16,265 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 19:01:16,265 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-19 19:01:16,266 INFO [RS:1;jenkins-hbase4:39869] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:16,266 INFO [RS:2;jenkins-hbase4:42277] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:16,266 INFO [RS:0;jenkins-hbase4:43479] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:16,267 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 19:01:16,266 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 19:01:16,266 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1022): About to register with Master. 2023-09-19 19:01:16,270 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33343,1695150073780 with isa=jenkins-hbase4.apache.org/172.31.14.131:43479, startcode=1695150075067 2023-09-19 19:01:16,270 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33343,1695150073780 with isa=jenkins-hbase4.apache.org/172.31.14.131:39869, startcode=1695150075115 2023-09-19 19:01:16,270 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33343,1695150073780 with isa=jenkins-hbase4.apache.org/172.31.14.131:42277, startcode=1695150075159 2023-09-19 19:01:16,290 DEBUG [RS:2;jenkins-hbase4:42277] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 19:01:16,290 DEBUG [RS:1;jenkins-hbase4:39869] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 19:01:16,290 DEBUG [RS:0;jenkins-hbase4:43479] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-19 19:01:16,376 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59285, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 19:01:16,376 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33269, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 19:01:16,376 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55043, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-19 19:01:16,389 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33343] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 19:01:16,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-19 19:01:16,397 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33343] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 19:01:16,399 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33343] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-19 19:01:16,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 19:01:16,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 19:01:16,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 19:01:16,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-19 19:01:16,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-19 19:01:16,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 19:01:16,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695150106411 2023-09-19 19:01:16,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-19 19:01:16,417 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-19 19:01:16,417 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-19 19:01:16,420 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 19:01:16,420 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 19:01:16,420 WARN [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 19:01:16,420 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(2830): Master is not running yet 2023-09-19 19:01:16,420 WARN [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 19:01:16,420 WARN [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-19 19:01:16,424 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 19:01:16,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-19 19:01:16,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-19 19:01:16,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-19 19:01:16,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-19 19:01:16,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-19 19:01:16,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,434 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-19 19:01:16,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-19 19:01:16,436 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-19 19:01:16,439 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-19 19:01:16,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-19 19:01:16,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695150076441,5,FailOnTimeoutGroup] 2023-09-19 19:01:16,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695150076441,5,FailOnTimeoutGroup] 2023-09-19 19:01:16,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,442 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-19 19:01:16,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,467 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:16,469 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:16,469 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:16,493 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:16,496 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-19 19:01:16,499 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/info 2023-09-19 19:01:16,500 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-19 19:01:16,501 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:16,501 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-19 19:01:16,504 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/rep_barrier 2023-09-19 19:01:16,505 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-19 19:01:16,505 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:16,506 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-19 19:01:16,508 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/table 2023-09-19 19:01:16,508 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-19 19:01:16,509 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:16,511 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740 2023-09-19 19:01:16,512 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740 2023-09-19 19:01:16,516 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-19 19:01:16,518 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-19 19:01:16,521 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33343,1695150073780 with isa=jenkins-hbase4.apache.org/172.31.14.131:43479, startcode=1695150075067 2023-09-19 19:01:16,521 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33343,1695150073780 with isa=jenkins-hbase4.apache.org/172.31.14.131:42277, startcode=1695150075159 2023-09-19 19:01:16,522 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,33343,1695150073780 with isa=jenkins-hbase4.apache.org/172.31.14.131:39869, startcode=1695150075115 2023-09-19 19:01:16,524 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:16,526 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66657825, jitterRate=-0.006721004843711853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-19 19:01:16,526 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-19 19:01:16,526 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-19 19:01:16,526 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-19 19:01:16,526 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-19 19:01:16,526 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-19 19:01:16,526 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-19 19:01:16,528 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-19 19:01:16,528 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-19 19:01:16,531 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33343] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,536 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-19 19:01:16,536 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-19 19:01:16,538 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33343] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,539 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33343] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,541 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:16,541 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:16,541 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37439 2023-09-19 19:01:16,541 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37439 2023-09-19 19:01:16,541 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 19:01:16,541 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 19:01:16,542 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:16,543 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:37439 2023-09-19 19:01:16,544 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-19 19:01:16,553 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-19 19:01:16,555 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:01:16,556 DEBUG [RS:2;jenkins-hbase4:42277] zookeeper.ZKUtil(162): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,556 DEBUG [RS:1;jenkins-hbase4:39869] zookeeper.ZKUtil(162): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,556 WARN [RS:2;jenkins-hbase4:42277] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 19:01:16,556 DEBUG [RS:0;jenkins-hbase4:43479] zookeeper.ZKUtil(162): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,557 INFO [RS:2;jenkins-hbase4:42277] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 19:01:16,556 WARN [RS:1;jenkins-hbase4:39869] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 19:01:16,557 WARN [RS:0;jenkins-hbase4:43479] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-19 19:01:16,558 INFO [RS:0;jenkins-hbase4:43479] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 19:01:16,558 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,559 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39869,1695150075115] 2023-09-19 19:01:16,559 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42277,1695150075159] 2023-09-19 19:01:16,559 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43479,1695150075067] 2023-09-19 19:01:16,558 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,557 INFO [RS:1;jenkins-hbase4:39869] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 19:01:16,560 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1948): logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,574 DEBUG [RS:1;jenkins-hbase4:39869] zookeeper.ZKUtil(162): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,574 DEBUG [RS:2;jenkins-hbase4:42277] zookeeper.ZKUtil(162): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,574 DEBUG [RS:0;jenkins-hbase4:43479] zookeeper.ZKUtil(162): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,575 DEBUG [RS:1;jenkins-hbase4:39869] zookeeper.ZKUtil(162): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,575 DEBUG [RS:0;jenkins-hbase4:43479] zookeeper.ZKUtil(162): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,575 DEBUG [RS:1;jenkins-hbase4:39869] zookeeper.ZKUtil(162): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,576 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-19 19:01:16,575 DEBUG [RS:2;jenkins-hbase4:42277] zookeeper.ZKUtil(162): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,577 DEBUG [RS:0;jenkins-hbase4:43479] zookeeper.ZKUtil(162): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,577 DEBUG [RS:2;jenkins-hbase4:42277] zookeeper.ZKUtil(162): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,580 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-19 19:01:16,590 DEBUG [RS:2;jenkins-hbase4:42277] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 19:01:16,590 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 19:01:16,590 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-19 19:01:16,600 INFO [RS:2;jenkins-hbase4:42277] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 19:01:16,601 INFO [RS:0;jenkins-hbase4:43479] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 19:01:16,600 INFO [RS:1;jenkins-hbase4:39869] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-19 19:01:16,625 INFO [RS:1;jenkins-hbase4:39869] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 19:01:16,625 INFO [RS:2;jenkins-hbase4:42277] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 19:01:16,625 INFO [RS:0;jenkins-hbase4:43479] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-19 19:01:16,630 INFO [RS:1;jenkins-hbase4:39869] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 19:01:16,630 INFO [RS:2;jenkins-hbase4:42277] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 19:01:16,631 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,630 INFO [RS:0;jenkins-hbase4:43479] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-19 19:01:16,631 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,631 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,631 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 19:01:16,632 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 19:01:16,632 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-19 19:01:16,640 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,640 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,640 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,641 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,641 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,641 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,641 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,641 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,641 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,641 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:0;jenkins-hbase4:43479] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:1;jenkins-hbase4:39869] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,642 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,645 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,645 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-19 19:01:16,646 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,646 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,646 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,646 DEBUG [RS:2;jenkins-hbase4:42277] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-19 19:01:16,646 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,646 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,646 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,647 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,647 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,647 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,649 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,650 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,650 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,667 INFO [RS:2;jenkins-hbase4:42277] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 19:01:16,667 INFO [RS:1;jenkins-hbase4:39869] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 19:01:16,667 INFO [RS:0;jenkins-hbase4:43479] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-19 19:01:16,671 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43479,1695150075067-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,671 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42277,1695150075159-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,671 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39869,1695150075115-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:16,691 INFO [RS:0;jenkins-hbase4:43479] regionserver.Replication(203): jenkins-hbase4.apache.org,43479,1695150075067 started 2023-09-19 19:01:16,692 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43479,1695150075067, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43479, sessionid=0x100c5909b960001 2023-09-19 19:01:16,692 INFO [RS:1;jenkins-hbase4:39869] regionserver.Replication(203): jenkins-hbase4.apache.org,39869,1695150075115 started 2023-09-19 19:01:16,692 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 19:01:16,692 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39869,1695150075115, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39869, sessionid=0x100c5909b960002 2023-09-19 19:01:16,692 DEBUG [RS:0;jenkins-hbase4:43479] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,692 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 19:01:16,692 DEBUG [RS:0;jenkins-hbase4:43479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43479,1695150075067' 2023-09-19 19:01:16,692 DEBUG [RS:1;jenkins-hbase4:39869] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,693 DEBUG [RS:0;jenkins-hbase4:43479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 19:01:16,693 DEBUG [RS:1;jenkins-hbase4:39869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39869,1695150075115' 2023-09-19 19:01:16,694 DEBUG [RS:1;jenkins-hbase4:39869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 19:01:16,695 DEBUG [RS:1;jenkins-hbase4:39869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 19:01:16,695 DEBUG [RS:0;jenkins-hbase4:43479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 19:01:16,695 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 19:01:16,696 INFO [RS:2;jenkins-hbase4:42277] regionserver.Replication(203): jenkins-hbase4.apache.org,42277,1695150075159 started 2023-09-19 19:01:16,695 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 19:01:16,696 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42277,1695150075159, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42277, sessionid=0x100c5909b960003 2023-09-19 19:01:16,696 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 19:01:16,696 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-19 19:01:16,696 DEBUG [RS:1;jenkins-hbase4:39869] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:16,696 DEBUG [RS:2;jenkins-hbase4:42277] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,696 DEBUG [RS:2;jenkins-hbase4:42277] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42277,1695150075159' 2023-09-19 19:01:16,696 DEBUG [RS:2;jenkins-hbase4:42277] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-19 19:01:16,696 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 19:01:16,696 DEBUG [RS:1;jenkins-hbase4:39869] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39869,1695150075115' 2023-09-19 19:01:16,697 DEBUG [RS:0;jenkins-hbase4:43479] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,697 DEBUG [RS:0;jenkins-hbase4:43479] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43479,1695150075067' 2023-09-19 19:01:16,697 DEBUG [RS:1;jenkins-hbase4:39869] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:16,697 DEBUG [RS:0;jenkins-hbase4:43479] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:16,697 DEBUG [RS:2;jenkins-hbase4:42277] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-19 19:01:16,698 DEBUG [RS:1;jenkins-hbase4:39869] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:16,698 DEBUG [RS:0;jenkins-hbase4:43479] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:16,698 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-19 19:01:16,698 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-19 19:01:16,698 DEBUG [RS:2;jenkins-hbase4:42277] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:16,698 DEBUG [RS:2;jenkins-hbase4:42277] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42277,1695150075159' 2023-09-19 19:01:16,698 DEBUG [RS:2;jenkins-hbase4:42277] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:16,698 DEBUG [RS:1;jenkins-hbase4:39869] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 19:01:16,699 INFO [RS:1;jenkins-hbase4:39869] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 19:01:16,699 INFO [RS:1;jenkins-hbase4:39869] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 19:01:16,699 DEBUG [RS:0;jenkins-hbase4:43479] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 19:01:16,699 INFO [RS:0;jenkins-hbase4:43479] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 19:01:16,699 INFO [RS:0;jenkins-hbase4:43479] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 19:01:16,701 DEBUG [RS:2;jenkins-hbase4:42277] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:16,701 DEBUG [RS:2;jenkins-hbase4:42277] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-19 19:01:16,701 INFO [RS:2;jenkins-hbase4:42277] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-19 19:01:16,701 INFO [RS:2;jenkins-hbase4:42277] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-19 19:01:16,732 DEBUG [jenkins-hbase4:33343] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-19 19:01:16,736 DEBUG [jenkins-hbase4:33343] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:01:16,742 DEBUG [jenkins-hbase4:33343] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:01:16,742 DEBUG [jenkins-hbase4:33343] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:01:16,742 DEBUG [jenkins-hbase4:33343] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:01:16,742 DEBUG [jenkins-hbase4:33343] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:01:16,746 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43479,1695150075067, state=OPENING 2023-09-19 19:01:16,756 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-19 19:01:16,758 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:16,758 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-19 19:01:16,763 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:16,810 INFO [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43479%2C1695150075067, suffix=, logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,43479,1695150075067, archiveDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs, maxLogs=32 2023-09-19 19:01:16,810 INFO [RS:2;jenkins-hbase4:42277] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42277%2C1695150075159, suffix=, logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,42277,1695150075159, archiveDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs, maxLogs=32 2023-09-19 19:01:16,812 INFO [RS:1;jenkins-hbase4:39869] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39869%2C1695150075115, suffix=, logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,39869,1695150075115, archiveDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs, maxLogs=32 2023-09-19 19:01:16,838 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK] 2023-09-19 19:01:16,838 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK] 2023-09-19 19:01:16,839 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK] 2023-09-19 19:01:16,840 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK] 2023-09-19 19:01:16,840 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK] 2023-09-19 19:01:16,841 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK] 2023-09-19 19:01:16,850 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK] 2023-09-19 19:01:16,850 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK] 2023-09-19 19:01:16,851 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK] 2023-09-19 19:01:16,852 INFO [RS:1;jenkins-hbase4:39869] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,39869,1695150075115/jenkins-hbase4.apache.org%2C39869%2C1695150075115.1695150076815 2023-09-19 19:01:16,852 DEBUG [RS:1;jenkins-hbase4:39869] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK], DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK], DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK]] 2023-09-19 19:01:16,860 INFO [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,43479,1695150075067/jenkins-hbase4.apache.org%2C43479%2C1695150075067.1695150076814 2023-09-19 19:01:16,860 INFO [RS:2;jenkins-hbase4:42277] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,42277,1695150075159/jenkins-hbase4.apache.org%2C42277%2C1695150075159.1695150076815 2023-09-19 19:01:16,860 DEBUG [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK], DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK], DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK]] 2023-09-19 19:01:16,860 DEBUG [RS:2;jenkins-hbase4:42277] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK], DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK], DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK]] 2023-09-19 19:01:16,960 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:16,962 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 19:01:16,966 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 19:01:16,984 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-19 19:01:16,984 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-19 19:01:16,988 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43479%2C1695150075067.meta, suffix=.meta, logDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,43479,1695150075067, archiveDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs, maxLogs=32 2023-09-19 19:01:17,009 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK] 2023-09-19 19:01:17,010 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK] 2023-09-19 19:01:17,011 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK] 2023-09-19 19:01:17,021 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/WALs/jenkins-hbase4.apache.org,43479,1695150075067/jenkins-hbase4.apache.org%2C43479%2C1695150075067.meta.1695150076990.meta 2023-09-19 19:01:17,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40785,DS-a23e4cef-084d-4204-9b49-ccc9005882b0,DISK], DatanodeInfoWithStorage[127.0.0.1:40645,DS-7b27dabd-963c-402e-9735-9969468290da,DISK], DatanodeInfoWithStorage[127.0.0.1:44535,DS-f7237923-9ebd-4534-aae4-d6bebd45d3b9,DISK]] 2023-09-19 19:01:17,022 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-19 19:01:17,023 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-19 19:01:17,025 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:17,025 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-19 19:01:17,028 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-19 19:01:17,030 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-19 19:01:17,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-19 19:01:17,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:17,044 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-19 19:01:17,045 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-19 19:01:17,048 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-19 19:01:17,050 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/info 2023-09-19 19:01:17,050 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/info 2023-09-19 19:01:17,050 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-19 19:01:17,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:17,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-19 19:01:17,053 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/rep_barrier 2023-09-19 19:01:17,053 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/rep_barrier 2023-09-19 19:01:17,054 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-19 19:01:17,054 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:17,055 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-19 19:01:17,056 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/table 2023-09-19 19:01:17,056 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/table 2023-09-19 19:01:17,057 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-19 19:01:17,057 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:17,060 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740 2023-09-19 19:01:17,062 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740 2023-09-19 19:01:17,066 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-19 19:01:17,068 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-19 19:01:17,070 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74919620, jitterRate=0.11638933420181274}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-19 19:01:17,072 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-19 19:01:17,085 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695150076948 2023-09-19 19:01:17,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-19 19:01:17,109 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-19 19:01:17,109 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43479,1695150075067, state=OPEN 2023-09-19 19:01:17,113 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-19 19:01:17,113 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-19 19:01:17,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-19 19:01:17,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43479,1695150075067 in 350 msec 2023-09-19 19:01:17,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-19 19:01:17,124 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 566 msec 2023-09-19 19:01:17,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 855 msec 2023-09-19 19:01:17,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695150077129, completionTime=-1 2023-09-19 19:01:17,129 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-19 19:01:17,130 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-19 19:01:17,198 DEBUG [hconnection-0x39ebf408-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:17,204 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:17,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-19 19:01:17,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695150137228 2023-09-19 19:01:17,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695150197228 2023-09-19 19:01:17,229 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 99 msec 2023-09-19 19:01:17,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33343,1695150073780-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:17,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33343,1695150073780-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:17,253 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33343,1695150073780-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:17,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:33343, period=300000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:17,255 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-19 19:01:17,264 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-19 19:01:17,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-19 19:01:17,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 19:01:17,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-19 19:01:17,285 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:01:17,288 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:01:17,314 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/namespace/c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,317 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/namespace/c93154be637ce47f70873b2989967c25 empty. 2023-09-19 19:01:17,318 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/namespace/c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,318 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-19 19:01:17,355 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:17,358 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c93154be637ce47f70873b2989967c25, NAME => 'hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:17,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:17,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c93154be637ce47f70873b2989967c25, disabling compactions & flushes 2023-09-19 19:01:17,377 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,377 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. after waiting 0 ms 2023-09-19 19:01:17,378 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,378 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,378 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c93154be637ce47f70873b2989967c25: 2023-09-19 19:01:17,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:01:17,399 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695150077385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150077385"}]},"ts":"1695150077385"} 2023-09-19 19:01:17,429 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-19 19:01:17,431 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:01:17,435 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150077431"}]},"ts":"1695150077431"} 2023-09-19 19:01:17,440 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-19 19:01:17,444 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:01:17,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:01:17,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:01:17,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:01:17,446 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:01:17,448 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c93154be637ce47f70873b2989967c25, ASSIGN}] 2023-09-19 19:01:17,461 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c93154be637ce47f70873b2989967c25, ASSIGN 2023-09-19 19:01:17,463 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c93154be637ce47f70873b2989967c25, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39869,1695150075115; forceNewPlan=false, retain=false 2023-09-19 19:01:17,616 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 19:01:17,617 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c93154be637ce47f70873b2989967c25, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:17,617 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695150077616"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150077616"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150077616"}]},"ts":"1695150077616"} 2023-09-19 19:01:17,622 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c93154be637ce47f70873b2989967c25, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:01:17,778 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:17,778 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 19:01:17,782 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 19:01:17,790 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,790 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c93154be637ce47f70873b2989967c25, NAME => 'hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.', STARTKEY => '', ENDKEY => ''} 2023-09-19 19:01:17,791 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. service=AccessControlService 2023-09-19 19:01:17,791 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:17,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:17,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,792 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,795 INFO [StoreOpener-c93154be637ce47f70873b2989967c25-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,797 DEBUG [StoreOpener-c93154be637ce47f70873b2989967c25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/info 2023-09-19 19:01:17,797 DEBUG [StoreOpener-c93154be637ce47f70873b2989967c25-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/info 2023-09-19 19:01:17,798 INFO [StoreOpener-c93154be637ce47f70873b2989967c25-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c93154be637ce47f70873b2989967c25 columnFamilyName info 2023-09-19 19:01:17,798 INFO [StoreOpener-c93154be637ce47f70873b2989967c25-1] regionserver.HStore(310): Store=c93154be637ce47f70873b2989967c25/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:17,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,801 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,806 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c93154be637ce47f70873b2989967c25 2023-09-19 19:01:17,811 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:17,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c93154be637ce47f70873b2989967c25; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63116109, jitterRate=-0.0594966858625412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:17,812 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c93154be637ce47f70873b2989967c25: 2023-09-19 19:01:17,814 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25., pid=6, masterSystemTime=1695150077778 2023-09-19 19:01:17,819 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,819 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:01:17,821 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c93154be637ce47f70873b2989967c25, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:17,821 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695150077820"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150077820"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150077820"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150077820"}]},"ts":"1695150077820"} 2023-09-19 19:01:17,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-19 19:01:17,829 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c93154be637ce47f70873b2989967c25, server=jenkins-hbase4.apache.org,39869,1695150075115 in 202 msec 2023-09-19 19:01:17,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-19 19:01:17,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c93154be637ce47f70873b2989967c25, ASSIGN in 381 msec 2023-09-19 19:01:17,835 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:01:17,835 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150077835"}]},"ts":"1695150077835"} 2023-09-19 19:01:17,838 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-19 19:01:17,841 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:01:17,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 569 msec 2023-09-19 19:01:17,885 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-19 19:01:17,887 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-19 19:01:17,887 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:17,909 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:17,912 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:17,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-19 19:01:17,947 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-19 19:01:17,954 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2023-09-19 19:01:17,963 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-19 19:01:17,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-19 19:01:17,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-19 19:01:17,990 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-19 19:01:17,993 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-19 19:01:17,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.768sec 2023-09-19 19:01:17,996 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-19 19:01:17,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-19 19:01:17,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-19 19:01:18,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33343,1695150073780-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-19 19:01:18,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33343,1695150073780-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-19 19:01:18,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-19 19:01:18,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-19 19:01:18,027 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:01:18,028 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:01:18,031 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,031 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a empty. 2023-09-19 19:01:18,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-19 19:01:18,034 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,034 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-19 19:01:18,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 19:01:18,058 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:18,060 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3dadf8876ef64551c42743f77f3e4f5a, NAME => 'hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:18,084 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:18,085 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 3dadf8876ef64551c42743f77f3e4f5a, disabling compactions & flushes 2023-09-19 19:01:18,085 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,085 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,085 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. after waiting 0 ms 2023-09-19 19:01:18,085 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,085 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,085 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 3dadf8876ef64551c42743f77f3e4f5a: 2023-09-19 19:01:18,090 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:01:18,090 ERROR [Listener at localhost/35845] master.TableStateManager(95): Unable to get table hbase:acl state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:acl at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2341) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2616) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2640) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2633) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot.setUpBeforeClass(TestMobSecureExportSnapshot.java:55) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2023-09-19 19:01:18,091 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695150078091"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150078091"}]},"ts":"1695150078091"} 2023-09-19 19:01:18,094 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-19 19:01:18,096 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:01:18,096 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150078096"}]},"ts":"1695150078096"} 2023-09-19 19:01:18,097 DEBUG [Listener at localhost/35845] zookeeper.ReadOnlyZKClient(139): Connect 0x51038fe2 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:18,099 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-19 19:01:18,105 DEBUG [Listener at localhost/35845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28ba846e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:18,107 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:01:18,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:01:18,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:01:18,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:01:18,109 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:01:18,109 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=3dadf8876ef64551c42743f77f3e4f5a, ASSIGN}] 2023-09-19 19:01:18,114 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=3dadf8876ef64551c42743f77f3e4f5a, ASSIGN 2023-09-19 19:01:18,116 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=3dadf8876ef64551c42743f77f3e4f5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:01:18,122 DEBUG [hconnection-0x1044170-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:18,134 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/test.cache.data in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop.tmp.dir in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop.log.dir in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-19 19:01:18,138 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/nfs.dump.dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-19 19:01:18,139 INFO [Listener at localhost/35845] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-19 19:01:18,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 19:01:18,266 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 19:01:18,267 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3dadf8876ef64551c42743f77f3e4f5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:18,267 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695150078267"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150078267"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150078267"}]},"ts":"1695150078267"} 2023-09-19 19:01:18,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3dadf8876ef64551c42743f77f3e4f5a, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:18,345 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 19:01:18,434 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,434 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3dadf8876ef64551c42743f77f3e4f5a, NAME => 'hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.', STARTKEY => '', ENDKEY => ''} 2023-09-19 19:01:18,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. service=AccessControlService 2023-09-19 19:01:18,435 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:18,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:18,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,435 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,438 INFO [StoreOpener-3dadf8876ef64551c42743f77f3e4f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,440 DEBUG [StoreOpener-3dadf8876ef64551c42743f77f3e4f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/l 2023-09-19 19:01:18,440 DEBUG [StoreOpener-3dadf8876ef64551c42743f77f3e4f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/l 2023-09-19 19:01:18,441 INFO [StoreOpener-3dadf8876ef64551c42743f77f3e4f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3dadf8876ef64551c42743f77f3e4f5a columnFamilyName l 2023-09-19 19:01:18,442 INFO [StoreOpener-3dadf8876ef64551c42743f77f3e4f5a-1] regionserver.HStore(310): Store=3dadf8876ef64551c42743f77f3e4f5a/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:18,444 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,445 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,451 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:01:18,455 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:18,456 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3dadf8876ef64551c42743f77f3e4f5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59336848, jitterRate=-0.11581206321716309}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:18,456 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3dadf8876ef64551c42743f77f3e4f5a: 2023-09-19 19:01:18,458 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a., pid=11, masterSystemTime=1695150078425 2023-09-19 19:01:18,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,462 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:01:18,463 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3dadf8876ef64551c42743f77f3e4f5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:18,463 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695150078463"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150078463"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150078463"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150078463"}]},"ts":"1695150078463"} 2023-09-19 19:01:18,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-19 19:01:18,472 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3dadf8876ef64551c42743f77f3e4f5a, server=jenkins-hbase4.apache.org,43479,1695150075067 in 197 msec 2023-09-19 19:01:18,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-19 19:01:18,476 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=3dadf8876ef64551c42743f77f3e4f5a, ASSIGN in 363 msec 2023-09-19 19:01:18,478 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:01:18,478 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150078478"}]},"ts":"1695150078478"} 2023-09-19 19:01:18,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-19 19:01:18,486 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:01:18,489 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 463 msec 2023-09-19 19:01:18,645 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-19 19:01:18,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-19 19:01:18,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-19 19:01:19,417 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:19,795 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:19,801 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41761_jobhistory____psryta/webapp 2023-09-19 19:01:19,979 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-19 19:01:19,979 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-19 19:01:19,979 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 19:01:19,983 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 19:01:20,073 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:20,407 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:20,700 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-19 19:01:20,734 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41761 2023-09-19 19:01:20,912 WARN [Listener at jenkins-hbase4.apache.org/37763] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:21,208 WARN [Listener at jenkins-hbase4.apache.org/37763] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 19:01:21,209 INFO [Listener at jenkins-hbase4.apache.org/37763] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:21,216 INFO [Listener at jenkins-hbase4.apache.org/37763] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46539_cluster____898dwr/webapp 2023-09-19 19:01:21,290 INFO [Listener at jenkins-hbase4.apache.org/37763] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 19:01:21,290 INFO [Listener at jenkins-hbase4.apache.org/37763] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-19 19:01:21,290 INFO [Listener at jenkins-hbase4.apache.org/37763] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 19:01:21,291 INFO [Listener at jenkins-hbase4.apache.org/37763] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 19:01:21,299 INFO [Listener at jenkins-hbase4.apache.org/37763] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:21,470 INFO [Listener at jenkins-hbase4.apache.org/37763] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:21,587 INFO [Listener at jenkins-hbase4.apache.org/37763] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:21,598 INFO [Listener at jenkins-hbase4.apache.org/37763] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46539 2023-09-19 19:01:22,114 WARN [Listener at jenkins-hbase4.apache.org/46849] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:22,138 WARN [Listener at jenkins-hbase4.apache.org/46849] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 19:01:22,139 INFO [Listener at jenkins-hbase4.apache.org/46849] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:22,145 INFO [Listener at jenkins-hbase4.apache.org/46849] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_37193_node____.ayy3dn/webapp 2023-09-19 19:01:22,198 INFO [Listener at jenkins-hbase4.apache.org/46849] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-19 19:01:22,198 INFO [Listener at jenkins-hbase4.apache.org/46849] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 19:01:22,198 INFO [Listener at jenkins-hbase4.apache.org/46849] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 19:01:22,199 INFO [Listener at jenkins-hbase4.apache.org/46849] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 19:01:22,207 INFO [Listener at jenkins-hbase4.apache.org/46849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:22,227 INFO [Listener at jenkins-hbase4.apache.org/46849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:22,299 INFO [Listener at jenkins-hbase4.apache.org/46849] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:22,313 INFO [Listener at jenkins-hbase4.apache.org/46849] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:37193 2023-09-19 19:01:22,497 WARN [Listener at jenkins-hbase4.apache.org/34965] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-19 19:01:22,502 WARN [Listener at jenkins-hbase4.apache.org/34965] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-19 19:01:22,503 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): jetty-6.1.26 2023-09-19 19:01:22,516 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_35253_node____.vyiihg/webapp 2023-09-19 19:01:22,568 INFO [Listener at jenkins-hbase4.apache.org/34965] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-19 19:01:22,569 INFO [Listener at jenkins-hbase4.apache.org/34965] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-19 19:01:22,569 INFO [Listener at jenkins-hbase4.apache.org/34965] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-19 19:01:22,569 INFO [Listener at jenkins-hbase4.apache.org/34965] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-19 19:01:22,577 INFO [Listener at jenkins-hbase4.apache.org/34965] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:22,598 INFO [Listener at jenkins-hbase4.apache.org/34965] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:22,603 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:01:22,730 INFO [Listener at jenkins-hbase4.apache.org/34965] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-19 19:01:22,739 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:35253 2023-09-19 19:01:22,769 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-19 19:01:22,771 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:22,781 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-19 19:01:22,783 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-19 19:01:22,784 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-19 19:01:22,843 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=710, OpenFileDescriptor=897, MaxFileDescriptor=60000, SystemLoadAverage=128, ProcessCount=166, AvailableMemoryMB=9911 2023-09-19 19:01:22,843 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=710 is superior to 500 2023-09-19 19:01:22,860 DEBUG [Listener at jenkins-hbase4.apache.org/34965] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-19 19:01:22,866 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-19 19:01:22,873 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 19:01:22,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:22,878 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:01:22,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-19 19:01:22,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 19:01:22,881 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:01:22,886 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:22,886 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:22,891 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e empty. 2023-09-19 19:01:22,891 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b empty. 2023-09-19 19:01:22,893 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:22,893 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:22,893 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-19 19:01:22,924 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:22,926 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3e6f896e0165fb7a85f8b565241a694e, NAME => 'testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:22,926 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3e4fe60a0d4a86b4a9c57a132b2c1b4b, NAME => 'testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:22,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:22,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 3e4fe60a0d4a86b4a9c57a132b2c1b4b, disabling compactions & flushes 2023-09-19 19:01:22,966 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:22,966 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 3e6f896e0165fb7a85f8b565241a694e, disabling compactions & flushes 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:22,967 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. after waiting 0 ms 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. after waiting 0 ms 2023-09-19 19:01:22,967 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 3e4fe60a0d4a86b4a9c57a132b2c1b4b: 2023-09-19 19:01:22,967 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:22,967 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 3e6f896e0165fb7a85f8b565241a694e: 2023-09-19 19:01:22,972 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:01:22,973 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150082973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150082973"}]},"ts":"1695150082973"} 2023-09-19 19:01:22,973 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150082973"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150082973"}]},"ts":"1695150082973"} 2023-09-19 19:01:22,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 19:01:23,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:01:23,023 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:01:23,023 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150083023"}]},"ts":"1695150083023"} 2023-09-19 19:01:23,025 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-19 19:01:23,030 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:01:23,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:01:23,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:01:23,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:01:23,032 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:01:23,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, ASSIGN}] 2023-09-19 19:01:23,035 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, ASSIGN 2023-09-19 19:01:23,035 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, ASSIGN 2023-09-19 19:01:23,036 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42277,1695150075159; forceNewPlan=false, retain=false 2023-09-19 19:01:23,037 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:01:23,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 19:01:23,187 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:01:23,189 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3e6f896e0165fb7a85f8b565241a694e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:23,189 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3e4fe60a0d4a86b4a9c57a132b2c1b4b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:23,189 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150083189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150083189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150083189"}]},"ts":"1695150083189"} 2023-09-19 19:01:23,190 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150083189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150083189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150083189"}]},"ts":"1695150083189"} 2023-09-19 19:01:23,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 3e6f896e0165fb7a85f8b565241a694e, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:23,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 3e4fe60a0d4a86b4a9c57a132b2c1b4b, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:01:23,350 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:23,350 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 19:01:23,352 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57800, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 19:01:23,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e6f896e0165fb7a85f8b565241a694e, NAME => 'testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 19:01:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. service=AccessControlService 2023-09-19 19:01:23,354 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,359 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:23,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3e4fe60a0d4a86b4a9c57a132b2c1b4b, NAME => 'testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 19:01:23,359 INFO [StoreOpener-3e6f896e0165fb7a85f8b565241a694e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. service=AccessControlService 2023-09-19 19:01:23,360 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:23,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:23,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,362 DEBUG [StoreOpener-3e6f896e0165fb7a85f8b565241a694e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf 2023-09-19 19:01:23,362 DEBUG [StoreOpener-3e6f896e0165fb7a85f8b565241a694e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf 2023-09-19 19:01:23,362 INFO [StoreOpener-3e4fe60a0d4a86b4a9c57a132b2c1b4b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,364 DEBUG [StoreOpener-3e4fe60a0d4a86b4a9c57a132b2c1b4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf 2023-09-19 19:01:23,364 DEBUG [StoreOpener-3e4fe60a0d4a86b4a9c57a132b2c1b4b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf 2023-09-19 19:01:23,366 INFO [StoreOpener-3e4fe60a0d4a86b4a9c57a132b2c1b4b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e4fe60a0d4a86b4a9c57a132b2c1b4b columnFamilyName cf 2023-09-19 19:01:23,366 INFO [StoreOpener-3e6f896e0165fb7a85f8b565241a694e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3e6f896e0165fb7a85f8b565241a694e columnFamilyName cf 2023-09-19 19:01:23,369 INFO [StoreOpener-3e4fe60a0d4a86b4a9c57a132b2c1b4b-1] regionserver.HStore(310): Store=3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:23,369 INFO [StoreOpener-3e6f896e0165fb7a85f8b565241a694e-1] regionserver.HStore(310): Store=3e6f896e0165fb7a85f8b565241a694e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:23,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:23,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:23,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:23,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:23,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3e6f896e0165fb7a85f8b565241a694e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72848998, jitterRate=0.08553466200828552}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:23,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3e6f896e0165fb7a85f8b565241a694e: 2023-09-19 19:01:23,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3e4fe60a0d4a86b4a9c57a132b2c1b4b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67765764, jitterRate=0.009788572788238525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:23,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3e4fe60a0d4a86b4a9c57a132b2c1b4b: 2023-09-19 19:01:23,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e., pid=15, masterSystemTime=1695150083345 2023-09-19 19:01:23,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b., pid=16, masterSystemTime=1695150083350 2023-09-19 19:01:23,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:23,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:23,399 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=3e4fe60a0d4a86b4a9c57a132b2c1b4b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:23,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:23,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:23,400 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150083399"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150083399"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150083399"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150083399"}]},"ts":"1695150083399"} 2023-09-19 19:01:23,401 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=3e6f896e0165fb7a85f8b565241a694e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:23,401 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150083401"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150083401"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150083401"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150083401"}]},"ts":"1695150083401"} 2023-09-19 19:01:23,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-19 19:01:23,408 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 3e4fe60a0d4a86b4a9c57a132b2c1b4b, server=jenkins-hbase4.apache.org,42277,1695150075159 in 208 msec 2023-09-19 19:01:23,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-19 19:01:23,412 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 3e6f896e0165fb7a85f8b565241a694e, server=jenkins-hbase4.apache.org,43479,1695150075067 in 212 msec 2023-09-19 19:01:23,411 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, ASSIGN in 376 msec 2023-09-19 19:01:23,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-19 19:01:23,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, ASSIGN in 379 msec 2023-09-19 19:01:23,415 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:01:23,416 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150083416"}]},"ts":"1695150083416"} 2023-09-19 19:01:23,418 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-19 19:01:23,421 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:01:23,426 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-19 19:01:23,446 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 19:01:23,480 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:23,480 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:23,480 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:23,480 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:23,480 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:01:23,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:23,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:23,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:23,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:23,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 19:01:23,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 617 msec 2023-09-19 19:01:23,962 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:23,962 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-19 19:01:23,963 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:23,963 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-19 19:01:23,963 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-19 19:01:23,963 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-19 19:01:23,963 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:23,963 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-19 19:01:23,964 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-19 19:01:23,964 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-19 19:01:23,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-19 19:01:23,992 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-19 19:01:23,997 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-19 19:01:23,998 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:24,000 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:24,026 DEBUG [hconnection-0x1044170-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:24,031 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:24,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 19:01:24,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150084046 (current time:1695150084046). 2023-09-19 19:01:24,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:01:24,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x0b299c44 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:24,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13c8e6a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:24,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:24,060 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:24,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b299c44 to 127.0.0.1:56787 2023-09-19 19:01:24,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:24,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x0778a5f1 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:24,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18934519, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:24,073 DEBUG [hconnection-0x62f9275f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:24,076 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0778a5f1 to 127.0.0.1:56787 2023-09-19 19:01:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:24,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 19:01:24,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:01:24,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 19:01:24,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 19:01:24,131 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 19:01:24,132 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695150684132 2023-09-19 19:01:24,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 19:01:24,132 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-19 19:01:24,135 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 19:01:24,136 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 19:01:24,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-19 19:01:24,139 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 19:01:24,140 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695150684140 2023-09-19 19:01:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:01:24,140 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:01:24,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,167 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-19 19:01:24,167 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:24,168 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-19 19:01:24,168 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-19 19:01:24,169 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,169 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,175 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:24,175 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:24,175 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,175 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:24,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:24,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:24,176 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,176 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,176 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,176 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 19:01:24,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 19:01:24,179 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 19:01:24,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,182 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 19:01:24,182 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:24,182 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 19:01:24,183 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 19:01:24,183 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:24,183 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 19:01:24,183 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 19:01:24,183 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 19:01:24,182 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 19:01:24,184 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 19:01:24,183 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 19:01:24,184 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:24,184 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 19:01:24,184 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-19 19:01:24,184 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-19 19:01:24,186 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,187 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,187 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,187 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:24,187 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,187 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:24,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,188 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:24,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:24,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-19 19:01:24,191 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4d667d[Count = 1] remaining members to acquire global barrier 2023-09-19 19:01:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:24,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:24,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-19 19:01:24,194 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3b4d667d[Count = 0] remaining members to acquire global barrier 2023-09-19 19:01:24,194 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-19 19:01:24,194 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 19:01:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,196 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,196 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 19:01:24,196 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 19:01:24,196 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 19:01:24,196 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:01:24,197 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,197 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:01:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:24,197 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:24,197 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:24,197 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:24,198 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. started... 2023-09-19 19:01:24,198 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. started... 2023-09-19 19:01:24,201 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 19:01:24,201 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:24,201 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 19:01:24,202 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e4fe60a0d4a86b4a9c57a132b2c1b4b: 2023-09-19 19:01:24,202 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e6f896e0165fb7a85f8b565241a694e: 2023-09-19 19:01:24,203 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,203 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,211 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:24,211 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:24,216 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:01:24,216 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:01:24,240 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:24,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:24,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:24,255 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:01:24,256 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. completed. 2023-09-19 19:01:24,256 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:24,256 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:24,256 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:24,256 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,257 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 19:01:24,257 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:01:24,259 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 19:01:24,259 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,259 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:24,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,259 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 19:01:24,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:24,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:24,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:24,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:24,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:24,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:01:24,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-19 19:01:24,455 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:24,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:24,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:24,457 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 19:01:24,652 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. completed. 2023-09-19 19:01:24,652 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:24,652 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:24,652 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:24,652 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,652 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-19 19:01:24,653 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:01:24,655 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,655 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 19:01:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:24,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:24,655 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:24,655 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-19 19:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:24,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:24,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:01:24,661 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-19 19:01:24,661 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-19 19:01:24,661 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:01:24,661 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:01:24,661 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,661 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:24,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:24,666 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:24,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:24,667 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,667 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,669 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:24,670 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,670 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:24,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:24,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:24,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:24,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,686 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:24,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:24,685 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:24,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-19 19:01:24,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:24,686 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:24,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:01:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:24,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:24,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:24,687 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,688 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 19:01:24,706 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,709 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,757 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:24,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:24,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:24,759 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-19 19:01:24,763 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-19 19:01:24,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,765 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:24,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695150084132Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695150084706 (+574 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695150084706Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695150084706Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695150084723 (+17 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695150084749 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695150084764 (+15 ms) 2023-09-19 19:01:24,768 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 19:01:24,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 634 msec 2023-09-19 19:01:25,259 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:25,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:25,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:01:25,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43479] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:01:25,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:01:25,287 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-19 19:01:25,287 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:25,287 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:25,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 19:01:25,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150085302 (current time:1695150085302). 2023-09-19 19:01:25,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:01:25,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x1159cdff to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:25,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@158c9409, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:25,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:25,315 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57124, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:25,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1159cdff to 127.0.0.1:56787 2023-09-19 19:01:25,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:25,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x1c59e3d4 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:25,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4330f395, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:25,325 DEBUG [hconnection-0x32ed1b26-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:25,328 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57128, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:25,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c59e3d4 to 127.0.0.1:56787 2023-09-19 19:01:25,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:25,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-19 19:01:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:01:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 19:01:25,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 19:01:25,341 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 19:01:25,343 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695150685343 2023-09-19 19:01:25,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-19 19:01:25,343 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-19 19:01:25,344 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:01:25,344 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:01:25,346 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-19 19:01:25,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 19:01:25,348 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-19 19:01:25,349 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 19:01:25,350 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695150685350 2023-09-19 19:01:25,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-19 19:01:25,370 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-19 19:01:25,370 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:25,371 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-19 19:01:25,371 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-19 19:01:25,371 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,371 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,378 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:25,378 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:25,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:25,378 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:25,378 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:25,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,379 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,379 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,379 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 19:01:25,380 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,380 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 19:01:25,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 19:01:25,381 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-19 19:01:25,381 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 19:01:25,381 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:25,381 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 19:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 19:01:25,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-19 19:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 19:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-19 19:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 19:01:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 19:01:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 19:01:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 19:01:25,382 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:25,383 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 19:01:25,384 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-19 19:01:25,384 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-19 19:01:25,384 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-19 19:01:25,387 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,387 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:25,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:25,387 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,387 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:25,388 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c31c8d[Count = 1] remaining members to acquire global barrier 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:25,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-19 19:01:25,393 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74c31c8d[Count = 0] remaining members to acquire global barrier 2023-09-19 19:01:25,393 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-19 19:01:25,394 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 19:01:25,399 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,399 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:25,400 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-19 19:01:25,400 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:25,400 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,400 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. started... 2023-09-19 19:01:25,400 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 19:01:25,400 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. started... 2023-09-19 19:01:25,400 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e6f896e0165fb7a85f8b565241a694e 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-19 19:01:25,400 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:01:25,401 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3e4fe60a0d4a86b4a9c57a132b2c1b4b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-19 19:01:25,404 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 19:01:25,404 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:25,404 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 19:01:25,444 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:25,446 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:01:25,548 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309197b6e48ea8d9f4b30988d95182fe37b93 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309197b6e48ea8d9f4b30988d95182fe37b93 2023-09-19 19:01:25,572 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/.tmp/cf/b4b22001a19a4a5db1903101a87a00fd 2023-09-19 19:01:25,582 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/.tmp/cf/b4b22001a19a4a5db1903101a87a00fd as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf/b4b22001a19a4a5db1903101a87a00fd 2023-09-19 19:01:25,590 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf/b4b22001a19a4a5db1903101a87a00fd, entries=3, sequenceid=6, filesize=5.4 K 2023-09-19 19:01:25,592 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 3e6f896e0165fb7a85f8b565241a694e in 192ms, sequenceid=6, compaction requested=false 2023-09-19 19:01:25,592 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-19 19:01:25,593 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e6f896e0165fb7a85f8b565241a694e: 2023-09-19 19:01:25,594 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 19:01:25,594 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:25,594 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf/b4b22001a19a4a5db1903101a87a00fd] hfiles 2023-09-19 19:01:25,594 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf/b4b22001a19a4a5db1903101a87a00fd for snapshot=snaptb0-testExportWithTargetName 2023-09-19 19:01:25,613 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. completed. 2023-09-19 19:01:25,614 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:25,614 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:25,614 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 19:01:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:01:25,617 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 19:01:25,617 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,617 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:25,617 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 19:01:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:01:25,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-19 19:01:25,646 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:25,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:25,648 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-19 19:01:25,908 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919cf971ed2588241f69f747fc41a47a8d4 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919cf971ed2588241f69f747fc41a47a8d4 2023-09-19 19:01:25,925 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/.tmp/cf/49af279c8c854596b1cf532e84a08b3d 2023-09-19 19:01:25,933 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/.tmp/cf/49af279c8c854596b1cf532e84a08b3d as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf/49af279c8c854596b1cf532e84a08b3d 2023-09-19 19:01:25,940 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf/49af279c8c854596b1cf532e84a08b3d, entries=47, sequenceid=6, filesize=12.8 K 2023-09-19 19:01:25,943 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 3e4fe60a0d4a86b4a9c57a132b2c1b4b in 543ms, sequenceid=6, compaction requested=false 2023-09-19 19:01:25,944 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3e4fe60a0d4a86b4a9c57a132b2c1b4b: 2023-09-19 19:01:25,944 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 19:01:25,945 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:25,945 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf/49af279c8c854596b1cf532e84a08b3d] hfiles 2023-09-19 19:01:25,945 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf/49af279c8c854596b1cf532e84a08b3d for snapshot=snaptb0-testExportWithTargetName 2023-09-19 19:01:25,948 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:25,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:25,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:25,951 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-19 19:01:25,960 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. completed. 2023-09-19 19:01:25,960 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-19 19:01:25,960 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:01:25,962 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-19 19:01:25,962 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,962 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:25,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:25,962 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-19 19:01:25,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:25,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:01:25,967 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-19 19:01:25,967 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-19 19:01:25,967 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:01:25,967 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:01:25,967 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-19 19:01:25,967 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:25,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,975 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:25,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:25,975 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:25,975 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,976 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:25,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:25,978 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-19 19:01:25,979 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,979 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,989 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:25,989 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:25,990 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,990 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:25,989 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:25,989 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:25,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:25,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:25,990 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:25,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-19 19:01:25,990 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:25,990 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-19 19:01:25,990 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:25,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-19 19:01:25,991 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:01:25,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:25,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:25,990 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:25,991 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,992 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:25,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:25,992 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,992 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:25,992 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:25,992 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,992 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-19 19:01:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:25,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:25,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:25,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:25,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:25,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919cf971ed2588241f69f747fc41a47a8d4, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309197b6e48ea8d9f4b30988d95182fe37b93] mob files 2023-09-19 19:01:25,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919cf971ed2588241f69f747fc41a47a8d4 2023-09-19 19:01:25,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309197b6e48ea8d9f4b30988d95182fe37b93 2023-09-19 19:01:26,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-19 19:01:26,008 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 19:01:26,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-19 19:01:26,053 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-19 19:01:26,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 19:01:26,053 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-19 19:01:26,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695150085343Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695150086007 (+664 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695150086007Loading Region manifests for snaptb0-testExportWithTargetName at 1695150086007Writing data manifest for snaptb0-testExportWithTargetName at 1695150086018 (+11 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695150086038 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695150086053 (+15 ms) 2023-09-19 19:01:26,056 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-19 19:01:26,059 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 713 msec 2023-09-19 19:01:26,451 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:26,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-19 19:01:26,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:01:26,454 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454 2023-09-19 19:01:26,455 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37439, tgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454, rawTgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:26,505 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:26,505 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-292118332_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-19 19:01:26,505 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-19 19:01:26,526 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-19 19:01:26,599 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:26,599 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:26,600 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:26,600 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,518 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-6070211653353319670.jar 2023-09-19 19:01:27,519 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,519 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,587 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-8366896492368163756.jar 2023-09-19 19:01:27,587 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,588 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,588 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,589 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,589 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,590 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:27,590 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:01:27,591 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:01:27,591 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:01:27,592 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:01:27,592 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:01:27,593 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:01:27,593 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:01:27,594 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:01:27,595 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:01:27,596 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:01:27,601 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:27,602 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:27,602 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:01:27,603 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:27,603 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:27,604 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:01:27,604 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:01:28,859 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:01:28,970 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:01:28,976 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-19 19:01:28,984 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-19 19:01:29,459 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:01:29,459 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:01:29,922 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0001_000001 (auth:SIMPLE) 2023-09-19 19:01:34,333 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0001_000001 (auth:SIMPLE) 2023-09-19 19:01:36,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0001_000001 (auth:SIMPLE) 2023-09-19 19:01:39,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0001_000001 (auth:SIMPLE) 2023-09-19 19:01:41,834 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:01:41,838 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:01:41,849 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-19 19:01:41,849 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:01:41,850 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:01:41,850 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-19 19:01:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-19 19:01:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-19 19:01:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454/.hbase-snapshot/testExportWithTargetName 2023-09-19 19:01:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-19 19:01:41,851 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150086454/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-19 19:01:41,863 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-19 19:01:41,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-19 19:01:41,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:41,881 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150101880"}]},"ts":"1695150101880"} 2023-09-19 19:01:41,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 19:01:41,883 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-19 19:01:41,884 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-19 19:01:41,886 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, UNASSIGN}] 2023-09-19 19:01:41,889 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, UNASSIGN 2023-09-19 19:01:41,889 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, UNASSIGN 2023-09-19 19:01:41,890 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3e6f896e0165fb7a85f8b565241a694e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:41,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3e4fe60a0d4a86b4a9c57a132b2c1b4b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:41,890 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150101890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150101890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150101890"}]},"ts":"1695150101890"} 2023-09-19 19:01:41,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150101890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150101890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150101890"}]},"ts":"1695150101890"} 2023-09-19 19:01:41,892 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 3e6f896e0165fb7a85f8b565241a694e, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:41,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 3e4fe60a0d4a86b4a9c57a132b2c1b4b, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:01:41,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 19:01:42,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:42,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3e4fe60a0d4a86b4a9c57a132b2c1b4b, disabling compactions & flushes 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3e6f896e0165fb7a85f8b565241a694e, disabling compactions & flushes 2023-09-19 19:01:42,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:42,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. after waiting 0 ms 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. after waiting 0 ms 2023-09-19 19:01:42,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:42,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:01:42,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:01:42,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:42,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:42,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e. 2023-09-19 19:01:42,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b. 2023-09-19 19:01:42,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3e6f896e0165fb7a85f8b565241a694e: 2023-09-19 19:01:42,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3e4fe60a0d4a86b4a9c57a132b2c1b4b: 2023-09-19 19:01:42,077 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:42,077 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=3e4fe60a0d4a86b4a9c57a132b2c1b4b, regionState=CLOSED 2023-09-19 19:01:42,078 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:42,078 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150102077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150102077"}]},"ts":"1695150102077"} 2023-09-19 19:01:42,079 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=3e6f896e0165fb7a85f8b565241a694e, regionState=CLOSED 2023-09-19 19:01:42,079 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695150102079"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150102079"}]},"ts":"1695150102079"} 2023-09-19 19:01:42,083 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-19 19:01:42,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 3e4fe60a0d4a86b4a9c57a132b2c1b4b, server=jenkins-hbase4.apache.org,42277,1695150075159 in 187 msec 2023-09-19 19:01:42,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-19 19:01:42,084 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 3e6f896e0165fb7a85f8b565241a694e, server=jenkins-hbase4.apache.org,43479,1695150075067 in 189 msec 2023-09-19 19:01:42,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e4fe60a0d4a86b4a9c57a132b2c1b4b, UNASSIGN in 198 msec 2023-09-19 19:01:42,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=22, resume processing ppid=21 2023-09-19 19:01:42,087 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=3e6f896e0165fb7a85f8b565241a694e, UNASSIGN in 198 msec 2023-09-19 19:01:42,088 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150102088"}]},"ts":"1695150102088"} 2023-09-19 19:01:42,090 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-19 19:01:42,092 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-19 19:01:42,096 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 224 msec 2023-09-19 19:01:42,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-19 19:01:42,185 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-19 19:01:42,190 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-19 19:01:42,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:42,200 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:42,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-19 19:01:42,202 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:42,206 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-19 19:01:42,208 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:42,208 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:42,210 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 19:01:42,210 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 19:01:42,210 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 19:01:42,210 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-19 19:01:42,212 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,212 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 19:01:42,212 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 19:01:42,212 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:01:42,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 19:01:42,212 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:01:42,212 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:01:42,212 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-19 19:01:42,212 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,212 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:01:42,213 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/recovered.edits] 2023-09-19 19:01:42,213 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/recovered.edits] 2023-09-19 19:01:42,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-19 19:01:42,221 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf/49af279c8c854596b1cf532e84a08b3d to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/cf/49af279c8c854596b1cf532e84a08b3d 2023-09-19 19:01:42,222 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf/b4b22001a19a4a5db1903101a87a00fd to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/cf/b4b22001a19a4a5db1903101a87a00fd 2023-09-19 19:01:42,225 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b/recovered.edits/9.seqid 2023-09-19 19:01:42,226 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e/recovered.edits/9.seqid 2023-09-19 19:01:42,226 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e4fe60a0d4a86b4a9c57a132b2c1b4b 2023-09-19 19:01:42,226 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportWithTargetName/3e6f896e0165fb7a85f8b565241a694e 2023-09-19 19:01:42,227 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-19 19:01:42,227 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-19 19:01:42,228 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-19 19:01:42,232 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919cf971ed2588241f69f747fc41a47a8d4 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230919cf971ed2588241f69f747fc41a47a8d4 2023-09-19 19:01:42,234 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309197b6e48ea8d9f4b30988d95182fe37b93 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202309197b6e48ea8d9f4b30988d95182fe37b93 2023-09-19 19:01:42,234 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-19 19:01:42,237 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:42,259 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-19 19:01:42,262 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-19 19:01:42,264 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:42,264 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-19 19:01:42,264 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150102264"}]},"ts":"9223372036854775807"} 2023-09-19 19:01:42,264 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150102264"}]},"ts":"9223372036854775807"} 2023-09-19 19:01:42,266 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 19:01:42,266 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3e6f896e0165fb7a85f8b565241a694e, NAME => 'testtb-testExportWithTargetName,,1695150082873.3e6f896e0165fb7a85f8b565241a694e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3e4fe60a0d4a86b4a9c57a132b2c1b4b, NAME => 'testtb-testExportWithTargetName,1,1695150082873.3e4fe60a0d4a86b4a9c57a132b2c1b4b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 19:01:42,266 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-19 19:01:42,267 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150102266"}]},"ts":"9223372036854775807"} 2023-09-19 19:01:42,268 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-19 19:01:42,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-19 19:01:42,272 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 80 msec 2023-09-19 19:01:42,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-19 19:01:42,319 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-19 19:01:42,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-19 19:01:42,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-19 19:01:42,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-19 19:01:42,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-19 19:01:42,377 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=758 (was 710) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:45543 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1285 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:46849 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_470115258_1 at /127.0.0.1:38572 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:48548 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:40834 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_470115258_1 at /127.0.0.1:48526 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:38592 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:43719 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=928 (was 897) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=193 (was 128) - SystemLoadAverage LEAK? -, ProcessCount=169 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=9141 (was 9911) 2023-09-19 19:01:42,377 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-19 19:01:42,396 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=758, OpenFileDescriptor=928, MaxFileDescriptor=60000, SystemLoadAverage=193, ProcessCount=169, AvailableMemoryMB=9140 2023-09-19 19:01:42,396 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-19 19:01:42,399 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 19:01:42,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:42,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:01:42,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-19 19:01:42,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 19:01:42,407 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:01:42,411 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,411 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,411 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 empty. 2023-09-19 19:01:42,411 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 empty. 2023-09-19 19:01:42,412 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,412 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,412 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-19 19:01:42,424 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:42,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 83a96c11829d122839d66eb489351124, NAME => 'testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:42,426 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 123e56f77128c14943474635e7d934c0, NAME => 'testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:42,451 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:42,452 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 83a96c11829d122839d66eb489351124, disabling compactions & flushes 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 123e56f77128c14943474635e7d934c0, disabling compactions & flushes 2023-09-19 19:01:42,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. after waiting 0 ms 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. after waiting 0 ms 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 83a96c11829d122839d66eb489351124: 2023-09-19 19:01:42,454 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 123e56f77128c14943474635e7d934c0: 2023-09-19 19:01:42,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:01:42,459 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150102458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150102458"}]},"ts":"1695150102458"} 2023-09-19 19:01:42,459 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150102458"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150102458"}]},"ts":"1695150102458"} 2023-09-19 19:01:42,468 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:01:42,469 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:01:42,469 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150102469"}]},"ts":"1695150102469"} 2023-09-19 19:01:42,471 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-19 19:01:42,476 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:01:42,477 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:01:42,477 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:01:42,477 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:01:42,477 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:01:42,477 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, ASSIGN}] 2023-09-19 19:01:42,480 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, ASSIGN 2023-09-19 19:01:42,480 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, ASSIGN 2023-09-19 19:01:42,482 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39869,1695150075115; forceNewPlan=false, retain=false 2023-09-19 19:01:42,482 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:01:42,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 19:01:42,632 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:01:42,635 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=123e56f77128c14943474635e7d934c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:42,635 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=83a96c11829d122839d66eb489351124, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:42,635 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150102635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150102635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150102635"}]},"ts":"1695150102635"} 2023-09-19 19:01:42,635 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150102635"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150102635"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150102635"}]},"ts":"1695150102635"} 2023-09-19 19:01:42,637 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 123e56f77128c14943474635e7d934c0, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:01:42,639 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 83a96c11829d122839d66eb489351124, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:42,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 19:01:42,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,798 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 83a96c11829d122839d66eb489351124, NAME => 'testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 19:01:42,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 123e56f77128c14943474635e7d934c0, NAME => 'testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. service=AccessControlService 2023-09-19 19:01:42,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. service=AccessControlService 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:42,799 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,799 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:42,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,801 INFO [StoreOpener-83a96c11829d122839d66eb489351124-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,805 INFO [StoreOpener-123e56f77128c14943474635e7d934c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,806 DEBUG [StoreOpener-83a96c11829d122839d66eb489351124-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf 2023-09-19 19:01:42,806 DEBUG [StoreOpener-83a96c11829d122839d66eb489351124-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf 2023-09-19 19:01:42,806 DEBUG [StoreOpener-123e56f77128c14943474635e7d934c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf 2023-09-19 19:01:42,806 INFO [StoreOpener-83a96c11829d122839d66eb489351124-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 83a96c11829d122839d66eb489351124 columnFamilyName cf 2023-09-19 19:01:42,806 DEBUG [StoreOpener-123e56f77128c14943474635e7d934c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf 2023-09-19 19:01:42,807 INFO [StoreOpener-123e56f77128c14943474635e7d934c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 123e56f77128c14943474635e7d934c0 columnFamilyName cf 2023-09-19 19:01:42,808 INFO [StoreOpener-83a96c11829d122839d66eb489351124-1] regionserver.HStore(310): Store=83a96c11829d122839d66eb489351124/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:42,808 INFO [StoreOpener-123e56f77128c14943474635e7d934c0-1] regionserver.HStore(310): Store=123e56f77128c14943474635e7d934c0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:42,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 83a96c11829d122839d66eb489351124 2023-09-19 19:01:42,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:42,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:42,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:42,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 83a96c11829d122839d66eb489351124; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68533150, jitterRate=0.021223515272140503}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:42,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 123e56f77128c14943474635e7d934c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59301292, jitterRate=-0.11634188890457153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:42,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 83a96c11829d122839d66eb489351124: 2023-09-19 19:01:42,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 123e56f77128c14943474635e7d934c0: 2023-09-19 19:01:42,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0., pid=30, masterSystemTime=1695150102790 2023-09-19 19:01:42,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124., pid=31, masterSystemTime=1695150102792 2023-09-19 19:01:42,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:42,824 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=123e56f77128c14943474635e7d934c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:42,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:42,824 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150102824"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150102824"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150102824"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150102824"}]},"ts":"1695150102824"} 2023-09-19 19:01:42,825 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=83a96c11829d122839d66eb489351124, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:42,825 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150102825"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150102825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150102825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150102825"}]},"ts":"1695150102825"} 2023-09-19 19:01:42,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-19 19:01:42,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 123e56f77128c14943474635e7d934c0, server=jenkins-hbase4.apache.org,39869,1695150075115 in 189 msec 2023-09-19 19:01:42,832 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-19 19:01:42,833 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 83a96c11829d122839d66eb489351124, server=jenkins-hbase4.apache.org,43479,1695150075067 in 188 msec 2023-09-19 19:01:42,834 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, ASSIGN in 353 msec 2023-09-19 19:01:42,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-19 19:01:42,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, ASSIGN in 356 msec 2023-09-19 19:01:42,837 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:01:42,837 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150102837"}]},"ts":"1695150102837"} 2023-09-19 19:01:42,839 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-19 19:01:42,841 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:01:42,842 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-19 19:01:42,844 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 19:01:42,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:42,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:42,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:42,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:42,848 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:42,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 448 msec 2023-09-19 19:01:43,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-19 19:01:43,012 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-19 19:01:43,015 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-19 19:01:43,015 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:43,017 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:43,029 DEBUG [hconnection-0x1044170-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:43,033 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50078, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:43,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:01:43,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150103039 (current time:1695150103039). 2023-09-19 19:01:43,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:01:43,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x12b21694 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:43,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ea86462, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:43,054 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52368, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:43,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12b21694 to 127.0.0.1:56787 2023-09-19 19:01:43,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:43,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x602c9012 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:43,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62a83c35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:43,067 DEBUG [hconnection-0x2feecf76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:43,068 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:43,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x602c9012 to 127.0.0.1:56787 2023-09-19 19:01:43,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:43,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 19:01:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:01:43,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:01:43,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:01:43,079 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:01:43,080 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695150703080 2023-09-19 19:01:43,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-19 19:01:43,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:01:43,081 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:01:43,081 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:01:43,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 19:01:43,082 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:01:43,084 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-19 19:01:43,085 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 19:01:43,086 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695150703086 2023-09-19 19:01:43,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,103 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-19 19:01:43,103 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,104 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-19 19:01:43,104 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-19 19:01:43,104 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,105 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,107 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,107 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,107 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,108 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,108 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,108 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,108 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 19:01:43,109 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 19:01:43,109 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-19 19:01:43,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,110 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 19:01:43,110 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 19:01:43,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,110 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 19:01:43,110 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 19:01:43,110 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 19:01:43,110 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,111 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 19:01:43,111 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 19:01:43,111 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 19:01:43,112 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,112 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 19:01:43,112 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,112 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 19:01:43,113 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-19 19:01:43,113 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-19 19:01:43,114 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,114 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,124 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,124 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,124 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:43,125 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,125 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,125 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:43,125 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,125 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,125 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:43,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@250f91b5[Count = 1] remaining members to acquire global barrier 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-19 19:01:43,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@250f91b5[Count = 0] remaining members to acquire global barrier 2023-09-19 19:01:43,129 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 19:01:43,129 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:01:43,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,130 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:43,131 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:43,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,131 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:01:43,131 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:43,131 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. started... 2023-09-19 19:01:43,131 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. started... 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 19:01:43,131 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 123e56f77128c14943474635e7d934c0: 2023-09-19 19:01:43,131 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83a96c11829d122839d66eb489351124: 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:43,133 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:01:43,138 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 19:01:43,138 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,138 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 19:01:43,149 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. completed. 2023-09-19 19:01:43,149 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:43,149 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:43,149 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:43,149 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,153 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 19:01:43,153 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:01:43,155 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 19:01:43,155 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,155 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,155 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 19:01:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,158 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. completed. 2023-09-19 19:01:43,158 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:43,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:43,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:43,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-19 19:01:43,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:01:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,160 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,160 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 19:01:43,160 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,160 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-19 19:01:43,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:01:43,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 19:01:43,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:01:43,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 19:01:43,168 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-19 19:01:43,168 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:01:43,168 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:01:43,168 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,168 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,170 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,171 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,172 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,172 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,174 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,175 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,175 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-19 19:01:43,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,180 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:01:43,180 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,182 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:43,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,180 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,183 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 19:01:43,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:01:43,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:43,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,184 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:01:43,193 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,194 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,228 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-19 19:01:43,228 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,229 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:43,229 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695150103080Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695150103193 (+113 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695150103193Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695150103194 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695150103198 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695150103218 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695150103228 (+10 ms) 2023-09-19 19:01:43,232 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 19:01:43,234 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 151 msec 2023-09-19 19:01:43,384 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:43,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:01:43,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:01:43,391 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43479] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:01:43,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39869] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:01:43,398 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-19 19:01:43,398 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:43,398 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:43,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:01:43,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150103411 (current time:1695150103411). 2023-09-19 19:01:43,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:01:43,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x08bcb795 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:43,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fddb690, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:43,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:43,427 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:43,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08bcb795 to 127.0.0.1:56787 2023-09-19 19:01:43,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:43,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x1add94e2 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:43,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@755bc973, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:43,439 DEBUG [hconnection-0x2470d208-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:43,442 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:43,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1add94e2 to 127.0.0.1:56787 2023-09-19 19:01:43,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:43,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 19:01:43,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:01:43,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:01:43,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:01:43,454 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:01:43,455 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695150703455 2023-09-19 19:01:43,455 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-19 19:01:43,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:01:43,457 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:01:43,457 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:01:43,459 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:01:43,459 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 19:01:43,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-19 19:01:43,462 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 19:01:43,463 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695150703463 2023-09-19 19:01:43,485 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-19 19:01:43,485 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-19 19:01:43,485 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,487 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-19 19:01:43,487 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-19 19:01:43,487 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,487 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,489 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,489 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,489 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,489 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,490 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,490 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 19:01:43,491 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 19:01:43,491 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,491 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-19 19:01:43,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 19:01:43,493 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 19:01:43,493 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-19 19:01:43,494 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,495 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-19 19:01:43,494 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 19:01:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 19:01:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 19:01:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:43,496 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 19:01:43,497 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 19:01:43,497 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-19 19:01:43,497 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-19 19:01:43,497 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 19:01:43,497 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-19 19:01:43,498 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,498 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,499 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,501 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,501 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,501 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,501 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:43,502 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,502 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:43,502 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,502 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d48389e[Count = 1] remaining members to acquire global barrier 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-19 19:01:43,506 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d48389e[Count = 0] remaining members to acquire global barrier 2023-09-19 19:01:43,506 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 19:01:43,506 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:01:43,508 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 19:01:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,508 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:01:43,508 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:01:43,508 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,508 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:01:43,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,509 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:01:43,509 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:43,509 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:43,509 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:43,509 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:43,509 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. started... 2023-09-19 19:01:43,509 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:43,509 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:43,509 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. started... 2023-09-19 19:01:43,509 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 123e56f77128c14943474635e7d934c0 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-19 19:01:43,509 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 83a96c11829d122839d66eb489351124 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-19 19:01:43,510 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 19:01:43,510 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,510 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 19:01:43,545 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230919af3623035ad44b7383997f92363be2a8 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919af3623035ad44b7383997f92363be2a8 2023-09-19 19:01:43,548 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919415b636c0ceb4b1e994c34b27ee8488a to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230919415b636c0ceb4b1e994c34b27ee8488a 2023-09-19 19:01:43,557 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:01:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:43,564 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:01:43,567 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/.tmp/cf/560c8b6741a04fcc9d85e5fd17ae0355 2023-09-19 19:01:43,569 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/.tmp/cf/dea4c26bd36744e5bc2d63045b0d5d4a 2023-09-19 19:01:43,574 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/.tmp/cf/560c8b6741a04fcc9d85e5fd17ae0355 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf/560c8b6741a04fcc9d85e5fd17ae0355 2023-09-19 19:01:43,575 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/.tmp/cf/dea4c26bd36744e5bc2d63045b0d5d4a as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf/dea4c26bd36744e5bc2d63045b0d5d4a 2023-09-19 19:01:43,581 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf/560c8b6741a04fcc9d85e5fd17ae0355, entries=48, sequenceid=6, filesize=13.0 K 2023-09-19 19:01:43,582 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf/dea4c26bd36744e5bc2d63045b0d5d4a, entries=2, sequenceid=6, filesize=5.2 K 2023-09-19 19:01:43,582 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 123e56f77128c14943474635e7d934c0 in 73ms, sequenceid=6, compaction requested=false 2023-09-19 19:01:43,582 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-19 19:01:43,582 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 123e56f77128c14943474635e7d934c0: 2023-09-19 19:01:43,583 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 83a96c11829d122839d66eb489351124 in 74ms, sequenceid=6, compaction requested=false 2023-09-19 19:01:43,583 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 83a96c11829d122839d66eb489351124: 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf/560c8b6741a04fcc9d85e5fd17ae0355] hfiles 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf/560c8b6741a04fcc9d85e5fd17ae0355 for snapshot=snaptb0-testExportFileSystemState 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf/dea4c26bd36744e5bc2d63045b0d5d4a] hfiles 2023-09-19 19:01:43,584 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf/dea4c26bd36744e5bc2d63045b0d5d4a for snapshot=snaptb0-testExportFileSystemState 2023-09-19 19:01:43,607 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. completed. 2023-09-19 19:01:43,607 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:43,607 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:43,608 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. completed. 2023-09-19 19:01:43,608 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-19 19:01:43,608 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:01:43,614 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 19:01:43,614 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,614 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,614 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 19:01:43,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-19 19:01:43,615 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-19 19:01:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:01:43,623 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 19:01:43,623 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-19 19:01:43,623 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:01:43,623 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:01:43,623 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-19 19:01:43,623 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,625 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,626 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:43,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,627 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,627 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:43,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,630 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,632 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:43,632 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-19 19:01:43,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:43,639 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,641 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-19 19:01:43,639 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:43,641 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-19 19:01:43,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,641 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-19 19:01:43,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,641 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:01:43,641 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,641 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,641 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:43,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,641 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:43,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:43,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:43,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230919415b636c0ceb4b1e994c34b27ee8488a, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919af3623035ad44b7383997f92363be2a8] mob files 2023-09-19 19:01:43,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230919415b636c0ceb4b1e994c34b27ee8488a 2023-09-19 19:01:43,642 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919af3623035ad44b7383997f92363be2a8 2023-09-19 19:01:43,651 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-19 19:01:43,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,677 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-19 19:01:43,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,679 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695150103455Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695150103651 (+196 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695150103651Loading Region manifests for snaptb0-testExportFileSystemState at 1695150103651Writing data manifest for snaptb0-testExportFileSystemState at 1695150103656 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695150103669 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695150103678 (+9 ms) 2023-09-19 19:01:43,681 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-19 19:01:43,684 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 224 msec 2023-09-19 19:01:43,764 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:43,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:01:43,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:01:43,766 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766 2023-09-19 19:01:43,766 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37439, tgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766, rawTgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:43,791 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:43,791 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_313358950_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,791 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-19 19:01:43,806 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-19 19:01:43,838 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:43,839 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:43,839 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:43,840 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,768 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-5019910698126508520.jar 2023-09-19 19:01:44,769 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,769 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,838 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-4215531509702055098.jar 2023-09-19 19:01:44,838 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,839 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,839 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,840 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,840 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,840 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:44,841 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:01:44,841 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:01:44,842 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:01:44,842 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:01:44,842 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:01:44,843 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:01:44,843 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:01:44,844 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:01:44,844 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:01:44,845 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:01:44,845 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:44,846 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:44,846 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:01:44,846 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:44,847 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:01:44,847 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:01:44,848 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:01:45,292 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:01:45,295 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-19 19:01:45,297 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-19 19:01:46,128 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:01:46,128 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:01:46,133 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0001_000001 (auth:SIMPLE) 2023-09-19 19:01:46,933 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0002_000001 (auth:SIMPLE) 2023-09-19 19:01:47,675 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:01:51,009 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0002_000001 (auth:SIMPLE) 2023-09-19 19:01:53,228 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0002_000001 (auth:SIMPLE) 2023-09-19 19:01:56,441 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0002_000001 (auth:SIMPLE) 2023-09-19 19:01:57,522 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:01:57,523 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:01:57,531 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-19 19:01:57,531 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:01:57,532 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:01:57,532 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 19:01:57,533 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-19 19:01:57,533 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-19 19:01:57,533 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-19 19:01:57,533 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-19 19:01:57,533 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150103766/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-19 19:01:57,541 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-19 19:01:57,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-19 19:01:57,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 19:01:57,547 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150117547"}]},"ts":"1695150117547"} 2023-09-19 19:01:57,549 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-19 19:01:57,551 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-19 19:01:57,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, UNASSIGN}] 2023-09-19 19:01:57,554 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, UNASSIGN 2023-09-19 19:01:57,554 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, UNASSIGN 2023-09-19 19:01:57,555 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=123e56f77128c14943474635e7d934c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:57,555 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150117555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150117555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150117555"}]},"ts":"1695150117555"} 2023-09-19 19:01:57,555 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=83a96c11829d122839d66eb489351124, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:57,556 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150117555"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150117555"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150117555"}]},"ts":"1695150117555"} 2023-09-19 19:01:57,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 123e56f77128c14943474635e7d934c0, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:01:57,558 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 83a96c11829d122839d66eb489351124, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:57,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 19:01:57,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:57,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 123e56f77128c14943474635e7d934c0, disabling compactions & flushes 2023-09-19 19:01:57,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:57,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:57,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. after waiting 0 ms 2023-09-19 19:01:57,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:57,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 83a96c11829d122839d66eb489351124 2023-09-19 19:01:57,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 83a96c11829d122839d66eb489351124, disabling compactions & flushes 2023-09-19 19:01:57,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:57,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:57,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. after waiting 0 ms 2023-09-19 19:01:57,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:57,728 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:01:57,729 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:57,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0. 2023-09-19 19:01:57,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 123e56f77128c14943474635e7d934c0: 2023-09-19 19:01:57,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 123e56f77128c14943474635e7d934c0 2023-09-19 19:01:57,734 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=123e56f77128c14943474635e7d934c0, regionState=CLOSED 2023-09-19 19:01:57,734 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150117734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150117734"}]},"ts":"1695150117734"} 2023-09-19 19:01:57,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:01:57,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:01:57,750 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124. 2023-09-19 19:01:57,751 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 83a96c11829d122839d66eb489351124: 2023-09-19 19:01:57,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=38 2023-09-19 19:01:57,751 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 123e56f77128c14943474635e7d934c0, server=jenkins-hbase4.apache.org,39869,1695150075115 in 182 msec 2023-09-19 19:01:57,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 83a96c11829d122839d66eb489351124 2023-09-19 19:01:57,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=123e56f77128c14943474635e7d934c0, UNASSIGN in 199 msec 2023-09-19 19:01:57,753 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=83a96c11829d122839d66eb489351124, regionState=CLOSED 2023-09-19 19:01:57,753 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695150117753"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150117753"}]},"ts":"1695150117753"} 2023-09-19 19:01:57,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=37 2023-09-19 19:01:57,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 83a96c11829d122839d66eb489351124, server=jenkins-hbase4.apache.org,43479,1695150075067 in 197 msec 2023-09-19 19:01:57,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-09-19 19:01:57,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=83a96c11829d122839d66eb489351124, UNASSIGN in 205 msec 2023-09-19 19:01:57,760 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150117760"}]},"ts":"1695150117760"} 2023-09-19 19:01:57,762 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-19 19:01:57,764 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-19 19:01:57,766 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 222 msec 2023-09-19 19:01:57,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-19 19:01:57,850 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-19 19:01:57,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-19 19:01:57,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,855 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-19 19:01:57,856 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,857 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-19 19:01:57,862 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,862 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,862 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,862 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,862 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 2023-09-19 19:01:57,862 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 2023-09-19 19:01:57,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 19:01:57,862 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 19:01:57,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 19:01:57,863 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:57,864 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/recovered.edits] 2023-09-19 19:01:57,864 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-19 19:01:57,865 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:57,865 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/recovered.edits] 2023-09-19 19:01:57,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-19 19:01:57,870 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf/560c8b6741a04fcc9d85e5fd17ae0355 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/cf/560c8b6741a04fcc9d85e5fd17ae0355 2023-09-19 19:01:57,870 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf/dea4c26bd36744e5bc2d63045b0d5d4a to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/cf/dea4c26bd36744e5bc2d63045b0d5d4a 2023-09-19 19:01:57,874 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0/recovered.edits/9.seqid 2023-09-19 19:01:57,874 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124/recovered.edits/9.seqid 2023-09-19 19:01:57,875 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/123e56f77128c14943474635e7d934c0 2023-09-19 19:01:57,875 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemState/83a96c11829d122839d66eb489351124 2023-09-19 19:01:57,875 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-19 19:01:57,875 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-19 19:01:57,876 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-19 19:01:57,880 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230919415b636c0ceb4b1e994c34b27ee8488a to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230919415b636c0ceb4b1e994c34b27ee8488a 2023-09-19 19:01:57,881 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919af3623035ad44b7383997f92363be2a8 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230919af3623035ad44b7383997f92363be2a8 2023-09-19 19:01:57,882 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-19 19:01:57,885 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,887 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-19 19:01:57,890 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-19 19:01:57,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,891 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-19 19:01:57,891 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150117891"}]},"ts":"9223372036854775807"} 2023-09-19 19:01:57,892 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150117891"}]},"ts":"9223372036854775807"} 2023-09-19 19:01:57,894 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 19:01:57,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 83a96c11829d122839d66eb489351124, NAME => 'testtb-testExportFileSystemState,,1695150102398.83a96c11829d122839d66eb489351124.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 123e56f77128c14943474635e7d934c0, NAME => 'testtb-testExportFileSystemState,1,1695150102398.123e56f77128c14943474635e7d934c0.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 19:01:57,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-19 19:01:57,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150117894"}]},"ts":"9223372036854775807"} 2023-09-19 19:01:57,896 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-19 19:01:57,899 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-19 19:01:57,901 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-09-19 19:01:57,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-19 19:01:57,967 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-19 19:01:57,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-19 19:01:57,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-19 19:01:57,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-19 19:01:57,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-19 19:01:58,007 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 758) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:50456 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:40791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-272158641_1 at /127.0.0.1:44686 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-272158641_1 at /127.0.0.1:41794 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:44722 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2082 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:34965 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=929 (was 928) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=216 (was 193) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 169), AvailableMemoryMB=9004 (was 9140) 2023-09-19 19:01:58,007 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-19 19:01:58,027 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=216, ProcessCount=168, AvailableMemoryMB=9003 2023-09-19 19:01:58,027 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-19 19:01:58,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 19:01:58,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:01:58,034 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:01:58,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-19 19:01:58,035 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:01:58,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 19:01:58,039 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,039 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,040 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 empty. 2023-09-19 19:01:58,040 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 empty. 2023-09-19 19:01:58,040 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,040 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,041 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-19 19:01:58,051 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-19 19:01:58,053 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => ce50f9e72d52f1e51d828c6eafcc2739, NAME => 'testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:58,053 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 76ee9bb00c0c231db6aa4cbdade223d2, NAME => 'testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:01:58,081 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:58,081 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:58,081 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing ce50f9e72d52f1e51d828c6eafcc2739, disabling compactions & flushes 2023-09-19 19:01:58,081 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 76ee9bb00c0c231db6aa4cbdade223d2, disabling compactions & flushes 2023-09-19 19:01:58,081 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,082 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. after waiting 0 ms 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. after waiting 0 ms 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,082 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,082 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for ce50f9e72d52f1e51d828c6eafcc2739: 2023-09-19 19:01:58,082 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 76ee9bb00c0c231db6aa4cbdade223d2: 2023-09-19 19:01:58,085 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:01:58,086 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150118086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150118086"}]},"ts":"1695150118086"} 2023-09-19 19:01:58,086 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150118086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150118086"}]},"ts":"1695150118086"} 2023-09-19 19:01:58,089 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:01:58,090 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:01:58,091 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150118090"}]},"ts":"1695150118090"} 2023-09-19 19:01:58,092 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-19 19:01:58,097 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:01:58,098 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:01:58,098 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:01:58,098 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:01:58,098 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:01:58,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, ASSIGN}] 2023-09-19 19:01:58,102 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, ASSIGN 2023-09-19 19:01:58,102 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, ASSIGN 2023-09-19 19:01:58,103 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:01:58,103 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42277,1695150075159; forceNewPlan=false, retain=false 2023-09-19 19:01:58,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 19:01:58,253 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:01:58,256 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=76ee9bb00c0c231db6aa4cbdade223d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,256 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ce50f9e72d52f1e51d828c6eafcc2739, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,256 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150118256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150118256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150118256"}]},"ts":"1695150118256"} 2023-09-19 19:01:58,257 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150118256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150118256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150118256"}]},"ts":"1695150118256"} 2023-09-19 19:01:58,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 76ee9bb00c0c231db6aa4cbdade223d2, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:01:58,260 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure ce50f9e72d52f1e51d828c6eafcc2739, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:01:58,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 19:01:58,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76ee9bb00c0c231db6aa4cbdade223d2, NAME => 'testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ce50f9e72d52f1e51d828c6eafcc2739, NAME => 'testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. service=AccessControlService 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. service=AccessControlService 2023-09-19 19:01:58,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:58,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:58,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:01:58,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,420 INFO [StoreOpener-ce50f9e72d52f1e51d828c6eafcc2739-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,420 INFO [StoreOpener-76ee9bb00c0c231db6aa4cbdade223d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,421 DEBUG [StoreOpener-ce50f9e72d52f1e51d828c6eafcc2739-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf 2023-09-19 19:01:58,421 DEBUG [StoreOpener-76ee9bb00c0c231db6aa4cbdade223d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf 2023-09-19 19:01:58,421 DEBUG [StoreOpener-76ee9bb00c0c231db6aa4cbdade223d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf 2023-09-19 19:01:58,421 DEBUG [StoreOpener-ce50f9e72d52f1e51d828c6eafcc2739-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf 2023-09-19 19:01:58,422 INFO [StoreOpener-ce50f9e72d52f1e51d828c6eafcc2739-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ce50f9e72d52f1e51d828c6eafcc2739 columnFamilyName cf 2023-09-19 19:01:58,422 INFO [StoreOpener-76ee9bb00c0c231db6aa4cbdade223d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76ee9bb00c0c231db6aa4cbdade223d2 columnFamilyName cf 2023-09-19 19:01:58,423 INFO [StoreOpener-76ee9bb00c0c231db6aa4cbdade223d2-1] regionserver.HStore(310): Store=76ee9bb00c0c231db6aa4cbdade223d2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:58,423 INFO [StoreOpener-ce50f9e72d52f1e51d828c6eafcc2739-1] regionserver.HStore(310): Store=ce50f9e72d52f1e51d828c6eafcc2739/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:01:58,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:01:58,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:01:58,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:58,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:01:58,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ce50f9e72d52f1e51d828c6eafcc2739; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66815164, jitterRate=-0.004376471042633057}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:58,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76ee9bb00c0c231db6aa4cbdade223d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69141181, jitterRate=0.030283883213996887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:01:58,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ce50f9e72d52f1e51d828c6eafcc2739: 2023-09-19 19:01:58,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76ee9bb00c0c231db6aa4cbdade223d2: 2023-09-19 19:01:58,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2., pid=45, masterSystemTime=1695150118411 2023-09-19 19:01:58,431 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739., pid=46, masterSystemTime=1695150118411 2023-09-19 19:01:58,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,434 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=76ee9bb00c0c231db6aa4cbdade223d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,434 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,434 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150118434"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150118434"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150118434"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150118434"}]},"ts":"1695150118434"} 2023-09-19 19:01:58,435 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=ce50f9e72d52f1e51d828c6eafcc2739, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,435 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150118435"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150118435"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150118435"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150118435"}]},"ts":"1695150118435"} 2023-09-19 19:01:58,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-09-19 19:01:58,443 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 76ee9bb00c0c231db6aa4cbdade223d2, server=jenkins-hbase4.apache.org,43479,1695150075067 in 177 msec 2023-09-19 19:01:58,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=43 2023-09-19 19:01:58,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure ce50f9e72d52f1e51d828c6eafcc2739, server=jenkins-hbase4.apache.org,42277,1695150075159 in 177 msec 2023-09-19 19:01:58,444 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, ASSIGN in 344 msec 2023-09-19 19:01:58,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=43, resume processing ppid=42 2023-09-19 19:01:58,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, ASSIGN in 344 msec 2023-09-19 19:01:58,446 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:01:58,446 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150118446"}]},"ts":"1695150118446"} 2023-09-19 19:01:58,448 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-19 19:01:58,450 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:01:58,450 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-19 19:01:58,452 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 19:01:58,454 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:58,454 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:58,454 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:58,454 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:01:58,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:58,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:58,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:58,456 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-19 19:01:58,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 426 msec 2023-09-19 19:01:58,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-19 19:01:58,641 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-19 19:01:58,644 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-19 19:01:58,644 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,647 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:58,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 19:01:58,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150118659 (current time:1695150118659). 2023-09-19 19:01:58,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:01:58,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x08eacc7a to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:58,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588c4d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:58,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:58,672 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40898, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08eacc7a to 127.0.0.1:56787 2023-09-19 19:01:58,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:58,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x5ccc1e17 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:58,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21b80e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:58,685 DEBUG [hconnection-0x384509c2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:58,688 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40908, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5ccc1e17 to 127.0.0.1:56787 2023-09-19 19:01:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:58,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 19:01:58,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:01:58,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 19:01:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 19:01:58,698 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 19:01:58,699 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695150718699 2023-09-19 19:01:58,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 19:01:58,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-19 19:01:58,700 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:01:58,700 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:01:58,704 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 19:01:58,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 19:01:58,705 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-09-19 19:01:58,706 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 19:01:58,707 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695150718707 2023-09-19 19:01:58,723 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,723 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-19 19:01:58,723 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:58,725 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-19 19:01:58,725 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-19 19:01:58,725 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,725 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,728 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:58,728 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:58,728 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:58,728 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:58,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:58,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:58,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:58,728 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,728 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,729 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,730 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 19:01:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 19:01:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:58,732 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 19:01:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 19:01:58,730 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 19:01:58,737 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 19:01:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 19:01:58,733 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 19:01:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-19 19:01:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 19:01:58,738 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-19 19:01:58,739 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,739 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:58,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:58,740 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,740 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:58,741 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de6d5c4[Count = 1] remaining members to acquire global barrier 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:58,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:58,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:58,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-19 19:01:58,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3de6d5c4[Count = 0] remaining members to acquire global barrier 2023-09-19 19:01:58,746 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-19 19:01:58,746 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 19:01:58,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,748 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 19:01:58,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:58,748 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,748 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,748 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. started... 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 19:01:58,748 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:01:58,748 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:58,748 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce50f9e72d52f1e51d828c6eafcc2739: 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:58,748 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. started... 2023-09-19 19:01:58,748 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:01:58,749 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,749 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:58,750 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:01:58,750 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76ee9bb00c0c231db6aa4cbdade223d2: 2023-09-19 19:01:58,750 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,752 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:58,752 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:01:58,762 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 19:01:58,762 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:58,762 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 19:01:58,769 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. completed. 2023-09-19 19:01:58,770 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:01:58,770 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. completed. 2023-09-19 19:01:58,770 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-19 19:01:58,770 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:01:58,771 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 19:01:58,771 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:58,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:58,771 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:58,772 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 19:01:58,773 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 19:01:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:58,773 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-19 19:01:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:58,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:01:58,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-19 19:01:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:58,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:01:58,782 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-19 19:01:58,782 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-19 19:01:58,782 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:01:58,782 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:01:58,782 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,782 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:01:58,784 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,784 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,784 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,784 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:58,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,784 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:58,784 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,785 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:58,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,785 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:58,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:58,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,786 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:58,786 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:58,788 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,788 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,789 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,791 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:58,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:58,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:58,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:58,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:58,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:58,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:58,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:58,792 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:58,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:58,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:58,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,793 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:58,794 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:01:58,792 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:58,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:58,794 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:58,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:58,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 19:01:58,800 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:58,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 19:01:58,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:58,802 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:01:58,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,804 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,820 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-19 19:01:58,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,821 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-19 19:01:58,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695150118699Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695150118803 (+104 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695150118803Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695150118803Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695150118806 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695150118814 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695150118820 (+6 ms) 2023-09-19 19:01:58,824 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 19:01:58,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 124 msec 2023-09-19 19:01:58,969 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-19 19:01:59,002 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:59,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 19:01:59,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:01:59,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:01:59,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43479] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:01:59,011 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-19 19:01:59,011 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:59,011 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:01:59,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 19:01:59,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150119021 (current time:1695150119021). 2023-09-19 19:01:59,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:01:59,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x55b0869a to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:59,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f05c0e5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:59,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:59,040 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:59,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55b0869a to 127.0.0.1:56787 2023-09-19 19:01:59,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:59,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x57f79660 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:01:59,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a24e52, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:01:59,052 DEBUG [hconnection-0x3791b48b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:01:59,054 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:01:59,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57f79660 to 127.0.0.1:56787 2023-09-19 19:01:59,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:01:59,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-19 19:01:59,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:01:59,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 19:01:59,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 19:01:59,065 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 19:01:59,065 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695150719065 2023-09-19 19:01:59,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-19 19:01:59,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-19 19:01:59,067 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:01:59,067 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:01:59,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 19:01:59,068 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-19 19:01:59,070 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-19 19:01:59,071 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 19:01:59,072 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695150719071 2023-09-19 19:01:59,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-19 19:01:59,084 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-19 19:01:59,084 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:59,086 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-19 19:01:59,086 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-19 19:01:59,086 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,086 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,087 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:59,088 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:59,088 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:59,087 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:59,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:59,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:59,088 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,088 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,089 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,089 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 19:01:59,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 19:01:59,090 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-19 19:01:59,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 19:01:59,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 19:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 19:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 19:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:59,090 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:59,090 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-19 19:01:59,091 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 19:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 19:01:59,092 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 19:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 19:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 19:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-19 19:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 19:01:59,093 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:01:59,094 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-19 19:01:59,094 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-19 19:01:59,094 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-19 19:01:59,095 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,095 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,095 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,095 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,096 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:59,096 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:59,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@512d8181[Count = 1] remaining members to acquire global barrier 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:59,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:59,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-19 19:01:59,100 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@512d8181[Count = 0] remaining members to acquire global barrier 2023-09-19 19:01:59,100 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-19 19:01:59,100 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,102 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,102 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,102 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 19:01:59,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 19:01:59,103 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:01:59,103 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:59,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-19 19:01:59,103 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,103 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:01:59,103 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. started... 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:01:59,103 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:01:59,103 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:59,104 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. started... 2023-09-19 19:01:59,104 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 76ee9bb00c0c231db6aa4cbdade223d2 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-19 19:01:59,104 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ce50f9e72d52f1e51d828c6eafcc2739 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-19 19:01:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 19:01:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:59,105 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 19:01:59,137 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091947ce8f855fe24b7099162f54e15c9a5b to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091947ce8f855fe24b7099162f54e15c9a5b 2023-09-19 19:01:59,143 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919c86c591953ab4ec3a2d73be063028726 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230919c86c591953ab4ec3a2d73be063028726 2023-09-19 19:01:59,149 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/.tmp/cf/ddb9ae610883444e901ee79e91f47929 2023-09-19 19:01:59,155 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/.tmp/cf/ddb9ae610883444e901ee79e91f47929 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf/ddb9ae610883444e901ee79e91f47929 2023-09-19 19:01:59,155 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/.tmp/cf/8ccc49c9f31b4f4688a2facd4e1b585d 2023-09-19 19:01:59,160 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf/ddb9ae610883444e901ee79e91f47929, entries=3, sequenceid=6, filesize=5.4 K 2023-09-19 19:01:59,161 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/.tmp/cf/8ccc49c9f31b4f4688a2facd4e1b585d as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf/8ccc49c9f31b4f4688a2facd4e1b585d 2023-09-19 19:01:59,161 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ce50f9e72d52f1e51d828c6eafcc2739 in 57ms, sequenceid=6, compaction requested=false 2023-09-19 19:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ce50f9e72d52f1e51d828c6eafcc2739: 2023-09-19 19:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 19:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf/ddb9ae610883444e901ee79e91f47929] hfiles 2023-09-19 19:01:59,163 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf/ddb9ae610883444e901ee79e91f47929 for snapshot=snaptb0-testConsecutiveExports 2023-09-19 19:01:59,167 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:59,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 19:01:59,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:01:59,169 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:01:59,169 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf/8ccc49c9f31b4f4688a2facd4e1b585d, entries=47, sequenceid=6, filesize=12.7 K 2023-09-19 19:01:59,170 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 76ee9bb00c0c231db6aa4cbdade223d2 in 67ms, sequenceid=6, compaction requested=false 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 76ee9bb00c0c231db6aa4cbdade223d2: 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. completed. 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:01:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf/8ccc49c9f31b4f4688a2facd4e1b585d] hfiles 2023-09-19 19:01:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 19:01:59,171 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:01:59,171 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf/8ccc49c9f31b4f4688a2facd4e1b585d for snapshot=snaptb0-testConsecutiveExports 2023-09-19 19:01:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 19:01:59,173 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:59,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:59,173 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 19:01:59,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:59,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:01:59,179 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-19 19:01:59,180 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. completed. 2023-09-19 19:01:59,180 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:01:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:01:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:01:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-19 19:01:59,180 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:01:59,182 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-19 19:01:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:59,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:59,182 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-19 19:01:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:59,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:01:59,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-19 19:01:59,187 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-19 19:01:59,187 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:01:59,187 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:01:59,187 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-19 19:01:59,187 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:01:59,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:59,189 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:59,190 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:01:59,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:59,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:59,190 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,190 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,191 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:01:59,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,193 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:01:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-19 19:01:59,193 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,194 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:01:59,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:59,205 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-19 19:01:59,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:01:59,205 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:59,205 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:01:59,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:01:59,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:59,205 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:01:59,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:59,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:01:59,207 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:59,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:01:59,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:59,208 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:01:59,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230919c86c591953ab4ec3a2d73be063028726, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091947ce8f855fe24b7099162f54e15c9a5b] mob files 2023-09-19 19:01:59,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230919c86c591953ab4ec3a2d73be063028726 2023-09-19 19:01:59,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091947ce8f855fe24b7099162f54e15c9a5b 2023-09-19 19:01:59,216 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-19 19:01:59,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,235 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-19 19:01:59,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,235 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,235 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695150119066Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695150119216 (+150 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695150119216Loading Region manifests for snaptb0-testConsecutiveExports at 1695150119216Writing data manifest for snaptb0-testConsecutiveExports at 1695150119219 (+3 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695150119227 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695150119235 (+8 ms) 2023-09-19 19:01:59,238 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-19 19:01:59,239 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 171 msec 2023-09-19 19:01:59,369 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:01:59,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-19 19:01:59,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:01:59,371 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371 2023-09-19 19:01:59,371 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:59,393 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:01:59,393 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2b147ec3, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,393 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-19 19:01:59,402 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:01:59,413 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:59,414 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:59,414 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:01:59,415 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,301 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-4149310504815552745.jar 2023-09-19 19:02:00,301 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,302 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,368 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-4837729430873658814.jar 2023-09-19 19:02:00,368 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,369 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,370 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,370 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:00,370 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:02:00,371 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:02:00,371 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:02:00,371 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:02:00,372 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:02:00,372 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:02:00,373 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:02:00,373 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:02:00,373 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:02:00,374 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:02:00,374 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:00,375 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:00,375 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:00,375 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:00,376 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:00,376 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:00,377 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:00,762 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:02:00,765 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-19 19:02:00,767 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-19 19:02:02,630 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:02,630 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:02,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0002_000001 (auth:SIMPLE) 2023-09-19 19:02:03,310 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:02:03,433 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0003_000001 (auth:SIMPLE) 2023-09-19 19:02:07,170 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0003_000001 (auth:SIMPLE) 2023-09-19 19:02:09,389 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0003_000001 (auth:SIMPLE) 2023-09-19 19:02:11,792 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0003_000001 (auth:SIMPLE) 2023-09-19 19:02:12,925 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:02:12,925 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:02:12,929 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-19 19:02:12,929 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:02:12,930 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:02:12,930 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 19:02:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 19:02:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 19:02:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1b0a281e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 19:02:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 19:02:12,934 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 19:02:12,936 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:12,961 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:12,961 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@767a063b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:02:12,961 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-19 19:02:12,973 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-19 19:02:12,984 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:12,985 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:12,985 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:12,986 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,882 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-2202995623115373382.jar 2023-09-19 19:02:13,883 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,883 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,949 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-2765791194481724310.jar 2023-09-19 19:02:13,950 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,950 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,951 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,951 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,951 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,952 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:13,952 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:02:13,952 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:02:13,953 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:02:13,953 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:02:13,953 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:02:13,954 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:02:13,954 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:02:13,955 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:02:13,955 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:02:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:02:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:13,957 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:13,957 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:13,957 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:13,959 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:14,331 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:02:14,333 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-19 19:02:14,335 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-19 19:02:17,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:17,967 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:17,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0003_000001 (auth:SIMPLE) 2023-09-19 19:02:18,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0004_000001 (auth:SIMPLE) 2023-09-19 19:02:22,406 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0004_000001 (auth:SIMPLE) 2023-09-19 19:02:24,625 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0004_000001 (auth:SIMPLE) 2023-09-19 19:02:26,814 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0004_000001 (auth:SIMPLE) 2023-09-19 19:02:28,616 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:02:28,616 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:02:28,619 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-19 19:02:28,619 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:02:28,620 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:02:28,620 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 19:02:28,624 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 19:02:28,624 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 19:02:28,624 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1b0a281e in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-19 19:02:28,624 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-19 19:02:28,624 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/local-export-1695150119371/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-19 19:02:28,638 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-19 19:02:28,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-19 19:02:28,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 19:02:28,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150148642"}]},"ts":"1695150148642"} 2023-09-19 19:02:28,644 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-19 19:02:28,646 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-19 19:02:28,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, UNASSIGN}] 2023-09-19 19:02:28,649 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, UNASSIGN 2023-09-19 19:02:28,649 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, UNASSIGN 2023-09-19 19:02:28,650 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ce50f9e72d52f1e51d828c6eafcc2739, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:28,650 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=76ee9bb00c0c231db6aa4cbdade223d2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:28,650 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150148650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150148650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150148650"}]},"ts":"1695150148650"} 2023-09-19 19:02:28,650 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150148650"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150148650"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150148650"}]},"ts":"1695150148650"} 2023-09-19 19:02:28,651 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure ce50f9e72d52f1e51d828c6eafcc2739, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:28,652 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 76ee9bb00c0c231db6aa4cbdade223d2, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:02:28,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 19:02:28,802 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:02:28,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ce50f9e72d52f1e51d828c6eafcc2739, disabling compactions & flushes 2023-09-19 19:02:28,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:02:28,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:02:28,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. after waiting 0 ms 2023-09-19 19:02:28,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:02:28,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:02:28,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76ee9bb00c0c231db6aa4cbdade223d2, disabling compactions & flushes 2023-09-19 19:02:28,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:02:28,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:02:28,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. after waiting 0 ms 2023-09-19 19:02:28,807 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:02:28,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:02:28,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:02:28,816 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:28,817 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739. 2023-09-19 19:02:28,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ce50f9e72d52f1e51d828c6eafcc2739: 2023-09-19 19:02:28,817 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:28,818 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2. 2023-09-19 19:02:28,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76ee9bb00c0c231db6aa4cbdade223d2: 2023-09-19 19:02:28,819 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:02:28,820 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=ce50f9e72d52f1e51d828c6eafcc2739, regionState=CLOSED 2023-09-19 19:02:28,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:02:28,820 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150148820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150148820"}]},"ts":"1695150148820"} 2023-09-19 19:02:28,820 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=76ee9bb00c0c231db6aa4cbdade223d2, regionState=CLOSED 2023-09-19 19:02:28,821 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695150148820"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150148820"}]},"ts":"1695150148820"} 2023-09-19 19:02:28,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=52 2023-09-19 19:02:28,824 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure ce50f9e72d52f1e51d828c6eafcc2739, server=jenkins-hbase4.apache.org,42277,1695150075159 in 170 msec 2023-09-19 19:02:28,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=53 2023-09-19 19:02:28,826 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 76ee9bb00c0c231db6aa4cbdade223d2, server=jenkins-hbase4.apache.org,43479,1695150075067 in 170 msec 2023-09-19 19:02:28,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ce50f9e72d52f1e51d828c6eafcc2739, UNASSIGN in 177 msec 2023-09-19 19:02:28,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-19 19:02:28,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=76ee9bb00c0c231db6aa4cbdade223d2, UNASSIGN in 179 msec 2023-09-19 19:02:28,829 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150148829"}]},"ts":"1695150148829"} 2023-09-19 19:02:28,830 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-19 19:02:28,832 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-19 19:02:28,834 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 195 msec 2023-09-19 19:02:28,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-19 19:02:28,945 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-19 19:02:28,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-19 19:02:28,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,949 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-19 19:02:28,950 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,954 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-19 19:02:28,956 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,956 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,956 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,956 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 19:02:28,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 19:02:28,957 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:02:28,957 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:02:28,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 19:02:28,957 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:28,958 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:28,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-19 19:02:28,959 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/recovered.edits] 2023-09-19 19:02:28,959 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/recovered.edits] 2023-09-19 19:02:28,964 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf/8ccc49c9f31b4f4688a2facd4e1b585d to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/cf/8ccc49c9f31b4f4688a2facd4e1b585d 2023-09-19 19:02:28,964 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf/ddb9ae610883444e901ee79e91f47929 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/cf/ddb9ae610883444e901ee79e91f47929 2023-09-19 19:02:28,967 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2/recovered.edits/9.seqid 2023-09-19 19:02:28,968 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/76ee9bb00c0c231db6aa4cbdade223d2 2023-09-19 19:02:28,968 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739/recovered.edits/9.seqid 2023-09-19 19:02:28,969 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testConsecutiveExports/ce50f9e72d52f1e51d828c6eafcc2739 2023-09-19 19:02:28,969 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-19 19:02:28,969 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-19 19:02:28,970 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-19 19:02:28,974 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230919c86c591953ab4ec3a2d73be063028726 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230919c86c591953ab4ec3a2d73be063028726 2023-09-19 19:02:28,975 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091947ce8f855fe24b7099162f54e15c9a5b to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091947ce8f855fe24b7099162f54e15c9a5b 2023-09-19 19:02:28,975 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-19 19:02:28,978 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,980 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-19 19:02:28,983 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-19 19:02:28,984 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,984 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-19 19:02:28,984 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150148984"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:28,984 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150148984"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:28,986 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 19:02:28,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ce50f9e72d52f1e51d828c6eafcc2739, NAME => 'testtb-testConsecutiveExports,,1695150118029.ce50f9e72d52f1e51d828c6eafcc2739.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 76ee9bb00c0c231db6aa4cbdade223d2, NAME => 'testtb-testConsecutiveExports,1,1695150118029.76ee9bb00c0c231db6aa4cbdade223d2.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 19:02:28,986 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-19 19:02:28,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150148986"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:28,988 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-19 19:02:28,991 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-19 19:02:28,992 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-09-19 19:02:29,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-19 19:02:29,061 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-19 19:02:29,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-19 19:02:29,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-19 19:02:29,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-19 19:02:29,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-19 19:02:29,098 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=748 (was 768), OpenFileDescriptor=900 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=173 (was 216), ProcessCount=168 (was 168), AvailableMemoryMB=8886 (was 9003) 2023-09-19 19:02:29,098 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-09-19 19:02:29,116 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=748, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=168, AvailableMemoryMB=8885 2023-09-19 19:02:29,117 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=748 is superior to 500 2023-09-19 19:02:29,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 19:02:29,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:02:29,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-19 19:02:29,123 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:02:29,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 19:02:29,126 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,126 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,126 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d empty. 2023-09-19 19:02:29,126 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e empty. 2023-09-19 19:02:29,127 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,127 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,127 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-19 19:02:29,137 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-19 19:02:29,138 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45c5169b6a624abd0ab0d3980155d79d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:29,139 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2fc345bddf482f98896b853b6169f76e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:29,160 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:29,160 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 2fc345bddf482f98896b853b6169f76e, disabling compactions & flushes 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 45c5169b6a624abd0ab0d3980155d79d, disabling compactions & flushes 2023-09-19 19:02:29,161 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,161 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. after waiting 0 ms 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,161 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. after waiting 0 ms 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 2fc345bddf482f98896b853b6169f76e: 2023-09-19 19:02:29,161 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,161 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 45c5169b6a624abd0ab0d3980155d79d: 2023-09-19 19:02:29,164 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:02:29,165 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150149164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150149164"}]},"ts":"1695150149164"} 2023-09-19 19:02:29,165 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150149164"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150149164"}]},"ts":"1695150149164"} 2023-09-19 19:02:29,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:02:29,170 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:02:29,171 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150149171"}]},"ts":"1695150149171"} 2023-09-19 19:02:29,172 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-19 19:02:29,175 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:02:29,176 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:02:29,176 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:02:29,176 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:02:29,176 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:02:29,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, ASSIGN}] 2023-09-19 19:02:29,179 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, ASSIGN 2023-09-19 19:02:29,179 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, ASSIGN 2023-09-19 19:02:29,180 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39869,1695150075115; forceNewPlan=false, retain=false 2023-09-19 19:02:29,180 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42277,1695150075159; forceNewPlan=false, retain=false 2023-09-19 19:02:29,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 19:02:29,330 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:02:29,333 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=45c5169b6a624abd0ab0d3980155d79d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,333 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2fc345bddf482f98896b853b6169f76e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,333 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150149333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150149333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150149333"}]},"ts":"1695150149333"} 2023-09-19 19:02:29,333 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150149333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150149333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150149333"}]},"ts":"1695150149333"} 2023-09-19 19:02:29,335 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 45c5169b6a624abd0ab0d3980155d79d, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:29,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 2fc345bddf482f98896b853b6169f76e, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:02:29,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 19:02:29,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2fc345bddf482f98896b853b6169f76e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45c5169b6a624abd0ab0d3980155d79d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. service=AccessControlService 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. service=AccessControlService 2023-09-19 19:02:29,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:29,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,497 INFO [StoreOpener-2fc345bddf482f98896b853b6169f76e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,497 INFO [StoreOpener-45c5169b6a624abd0ab0d3980155d79d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,499 DEBUG [StoreOpener-2fc345bddf482f98896b853b6169f76e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf 2023-09-19 19:02:29,499 DEBUG [StoreOpener-45c5169b6a624abd0ab0d3980155d79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf 2023-09-19 19:02:29,499 DEBUG [StoreOpener-45c5169b6a624abd0ab0d3980155d79d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf 2023-09-19 19:02:29,499 DEBUG [StoreOpener-2fc345bddf482f98896b853b6169f76e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf 2023-09-19 19:02:29,500 INFO [StoreOpener-45c5169b6a624abd0ab0d3980155d79d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45c5169b6a624abd0ab0d3980155d79d columnFamilyName cf 2023-09-19 19:02:29,500 INFO [StoreOpener-2fc345bddf482f98896b853b6169f76e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2fc345bddf482f98896b853b6169f76e columnFamilyName cf 2023-09-19 19:02:29,502 INFO [StoreOpener-2fc345bddf482f98896b853b6169f76e-1] regionserver.HStore(310): Store=2fc345bddf482f98896b853b6169f76e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:29,502 INFO [StoreOpener-45c5169b6a624abd0ab0d3980155d79d-1] regionserver.HStore(310): Store=45c5169b6a624abd0ab0d3980155d79d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:29,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,503 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:29,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:29,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:29,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:29,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 45c5169b6a624abd0ab0d3980155d79d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68567233, jitterRate=0.021731391549110413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:29,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2fc345bddf482f98896b853b6169f76e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58883608, jitterRate=-0.1225658655166626}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:29,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 45c5169b6a624abd0ab0d3980155d79d: 2023-09-19 19:02:29,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2fc345bddf482f98896b853b6169f76e: 2023-09-19 19:02:29,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d., pid=60, masterSystemTime=1695150149489 2023-09-19 19:02:29,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e., pid=61, masterSystemTime=1695150149489 2023-09-19 19:02:29,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,512 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=45c5169b6a624abd0ab0d3980155d79d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,512 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150149512"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150149512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150149512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150149512"}]},"ts":"1695150149512"} 2023-09-19 19:02:29,513 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=2fc345bddf482f98896b853b6169f76e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,513 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150149513"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150149513"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150149513"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150149513"}]},"ts":"1695150149513"} 2023-09-19 19:02:29,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=58 2023-09-19 19:02:29,517 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 45c5169b6a624abd0ab0d3980155d79d, server=jenkins-hbase4.apache.org,42277,1695150075159 in 179 msec 2023-09-19 19:02:29,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=59 2023-09-19 19:02:29,517 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 2fc345bddf482f98896b853b6169f76e, server=jenkins-hbase4.apache.org,39869,1695150075115 in 179 msec 2023-09-19 19:02:29,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, ASSIGN in 341 msec 2023-09-19 19:02:29,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-19 19:02:29,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, ASSIGN in 341 msec 2023-09-19 19:02:29,520 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:02:29,520 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150149520"}]},"ts":"1695150149520"} 2023-09-19 19:02:29,521 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-19 19:02:29,524 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:02:29,524 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-19 19:02:29,526 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 19:02:29,528 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:29,528 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:29,528 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:29,528 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:29,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:29,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:29,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:29,530 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:29,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 411 msec 2023-09-19 19:02:29,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-19 19:02:29,727 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-19 19:02:29,731 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,731 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,732 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:02:29,744 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 19:02:29,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150149744 (current time:1695150149744). 2023-09-19 19:02:29,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:29,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x23d7a82c to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:29,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69f789c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:29,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:29,757 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:29,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23d7a82c to 127.0.0.1:56787 2023-09-19 19:02:29,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:29,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x780acf77 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:29,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66828e92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:29,767 DEBUG [hconnection-0x336ea20b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:29,770 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:29,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x780acf77 to 127.0.0.1:56787 2023-09-19 19:02:29,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:29,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 19:02:29,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:29,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 19:02:29,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 19:02:29,779 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 19:02:29,779 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695150749779 2023-09-19 19:02:29,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 19:02:29,779 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,781 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:29,781 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:29,782 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 19:02:29,782 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 19:02:29,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-19 19:02:29,783 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 19:02:29,784 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695150749784 2023-09-19 19:02:29,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,796 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-19 19:02:29,796 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:29,797 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-19 19:02:29,797 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-19 19:02:29,797 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,797 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,799 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,799 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:29,799 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:29,799 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:29,799 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:29,799 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,800 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,800 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 19:02:29,801 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 19:02:29,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,801 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:29,801 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 19:02:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 19:02:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 19:02:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 19:02:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 19:02:29,801 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,803 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 19:02:29,803 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 19:02:29,803 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:29,802 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 19:02:29,803 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 19:02:29,803 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 19:02:29,803 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 19:02:29,805 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,805 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,805 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:29,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:29,805 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:29,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:29,807 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,808 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f62028[Count = 1] remaining members to acquire global barrier 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:29,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:29,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:29,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:29,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 19:02:29,811 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@8f62028[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:29,811 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-19 19:02:29,811 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,812 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,812 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 19:02:29,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,813 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 19:02:29,813 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 19:02:29,813 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. started... 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:29,813 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,813 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:29,813 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45c5169b6a624abd0ab0d3980155d79d: 2023-09-19 19:02:29,813 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. started... 2023-09-19 19:02:29,813 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,814 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fc345bddf482f98896b853b6169f76e: 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:29,815 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:02:29,820 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 19:02:29,820 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:29,820 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 19:02:29,833 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. completed. 2023-09-19 19:02:29,833 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,833 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. completed. 2023-09-19 19:02:29,833 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 19:02:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,833 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 19:02:29,834 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:29,836 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 19:02:29,836 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,836 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:29,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:29,836 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 19:02:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 19:02:29,837 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:29,837 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 19:02:29,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:29,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:02:29,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-19 19:02:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:29,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:29,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:29,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:29,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:29,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:02:29,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-19 19:02:29,845 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-19 19:02:29,845 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:29,845 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:29,845 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,845 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:29,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,847 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:29,847 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,846 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:29,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:29,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:29,847 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:29,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,847 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,848 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:29,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:29,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:29,848 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:29,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,850 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,850 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:29,851 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:29,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:29,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:29,854 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:29,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:29,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:29,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:29,854 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:29,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:29,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:29,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:29,856 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:29,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:29,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:29,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,857 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 19:02:29,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,882 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:29,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 19:02:29,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:02:29,883 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:02:29,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,890 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-19 19:02:29,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,891 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:29,891 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695150149780Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695150149867 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695150149867Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695150149867Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695150149871 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695150149884 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695150149890 (+6 ms) 2023-09-19 19:02:29,894 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 19:02:29,895 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 113 msec 2023-09-19 19:02:30,083 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:30,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 19:02:30,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:30,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:02:30,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39869] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:02:30,092 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,092 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:30,092 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:02:30,102 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 19:02:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150150102 (current time:1695150150102). 2023-09-19 19:02:30,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:30,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x06aa4380 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:30,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5397af75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:30,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:30,113 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:30,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06aa4380 to 127.0.0.1:56787 2023-09-19 19:02:30,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:30,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x06305346 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:30,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52d2a643, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:30,122 DEBUG [hconnection-0x3c50476b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:30,125 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59238, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:30,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06305346 to 127.0.0.1:56787 2023-09-19 19:02:30,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:30,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-19 19:02:30,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:30,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 19:02:30,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 19:02:30,133 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 19:02:30,134 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695150750134 2023-09-19 19:02:30,134 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-19 19:02:30,135 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:30,136 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-19 19:02:30,135 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 19:02:30,136 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:30,137 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-19 19:02:30,138 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 19:02:30,139 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695150750139 2023-09-19 19:02:30,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,147 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-19 19:02:30,147 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:30,148 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-19 19:02:30,148 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-19 19:02:30,149 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,149 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,151 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,151 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:30,151 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:30,151 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:30,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:30,152 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:30,152 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,152 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:30,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:30,152 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,152 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,152 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 19:02:30,153 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-19 19:02:30,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 19:02:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 19:02:30,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-19 19:02:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 19:02:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:30,154 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:30,156 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 19:02:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-19 19:02:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 19:02:30,155 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 19:02:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 19:02:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 19:02:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-19 19:02:30,157 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,159 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,159 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,159 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:30,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d67560[Count = 1] remaining members to acquire global barrier 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:30,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:30,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:30,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-19 19:02:30,164 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24d67560[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:30,164 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-19 19:02:30,164 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 19:02:30,165 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,165 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,165 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:30,166 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:30,166 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:30,166 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. started... 2023-09-19 19:02:30,166 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. started... 2023-09-19 19:02:30,166 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,166 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:30,166 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2fc345bddf482f98896b853b6169f76e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-19 19:02:30,166 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:30,166 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45c5169b6a624abd0ab0d3980155d79d 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-19 19:02:30,167 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 19:02:30,167 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:30,167 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 19:02:30,187 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091925958d98200c43ab8d76cbbef33a3981 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091925958d98200c43ab8d76cbbef33a3981 2023-09-19 19:02:30,188 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919c9da621ddcc24d58bf32608bc378ce87 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230919c9da621ddcc24d58bf32608bc378ce87 2023-09-19 19:02:30,198 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/.tmp/cf/eca6234c83e4487b9e10a7421ab7169a 2023-09-19 19:02:30,199 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/.tmp/cf/030278111c8d45ceb5fab79a683881e1 2023-09-19 19:02:30,204 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/.tmp/cf/eca6234c83e4487b9e10a7421ab7169a as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf/eca6234c83e4487b9e10a7421ab7169a 2023-09-19 19:02:30,204 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/.tmp/cf/030278111c8d45ceb5fab79a683881e1 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf/030278111c8d45ceb5fab79a683881e1 2023-09-19 19:02:30,209 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf/eca6234c83e4487b9e10a7421ab7169a, entries=3, sequenceid=6, filesize=5.4 K 2023-09-19 19:02:30,209 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf/030278111c8d45ceb5fab79a683881e1, entries=47, sequenceid=6, filesize=13.5 K 2023-09-19 19:02:30,210 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 2fc345bddf482f98896b853b6169f76e in 44ms, sequenceid=6, compaction requested=false 2023-09-19 19:02:30,210 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-19 19:02:30,211 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2fc345bddf482f98896b853b6169f76e: 2023-09-19 19:02:30,211 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,211 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:30,211 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf/030278111c8d45ceb5fab79a683881e1] hfiles 2023-09-19 19:02:30,211 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf/030278111c8d45ceb5fab79a683881e1 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,213 INFO [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 45c5169b6a624abd0ab0d3980155d79d in 47ms, sequenceid=6, compaction requested=false 2023-09-19 19:02:30,215 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45c5169b6a624abd0ab0d3980155d79d: 2023-09-19 19:02:30,215 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,215 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:30,215 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf/eca6234c83e4487b9e10a7421ab7169a] hfiles 2023-09-19 19:02:30,215 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf/eca6234c83e4487b9e10a7421ab7169a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,222 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. completed. 2023-09-19 19:02:30,222 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 19:02:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:30,225 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. completed. 2023-09-19 19:02:30,225 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,225 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:30,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:30,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:30,225 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 19:02:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:30,228 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,228 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-19 19:02:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:30,228 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:30,228 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-19 19:02:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:30,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:02:30,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-19 19:02:30,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:02:30,236 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-19 19:02:30,236 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-19 19:02:30,236 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:30,236 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:30,236 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,236 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:30,236 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:30,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 19:02:30,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:02:30,238 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:02:30,240 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,240 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,240 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:30,240 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,240 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,240 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:30,241 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,241 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:30,241 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:30,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:30,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,242 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,243 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:30,244 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,244 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:30,247 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:30,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:30,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:30,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:30,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:30,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:30,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,247 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:30,249 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:30,249 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:02:30,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:30,249 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:30,250 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:30,250 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:30,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:30,250 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,251 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,251 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:30,251 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,252 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230919c9da621ddcc24d58bf32608bc378ce87, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091925958d98200c43ab8d76cbbef33a3981] mob files 2023-09-19 19:02:30,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230919c9da621ddcc24d58bf32608bc378ce87 2023-09-19 19:02:30,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091925958d98200c43ab8d76cbbef33a3981 2023-09-19 19:02:30,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,278 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-19 19:02:30,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,279 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:30,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695150150134Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695150150261 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695150150261Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695150150261Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695150150264 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695150150272 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695150150279 (+7 ms) 2023-09-19 19:02:30,282 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-19 19:02:30,283 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 147 msec 2023-09-19 19:02:30,438 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:30,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-19 19:02:30,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:30,467 DEBUG [Listener at jenkins-hbase4.apache.org/34965] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 19:02:30,473 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 19:02:30,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39869] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 19:02:30,476 DEBUG [Listener at jenkins-hbase4.apache.org/34965] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 19:02:30,478 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 19:02:30,478 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42277] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 19:02:30,479 DEBUG [Listener at jenkins-hbase4.apache.org/34965] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-19 19:02:30,483 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-19 19:02:30,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43479] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-19 19:02:30,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-19 19:02:30,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:30,488 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:02:30,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-19 19:02:30,489 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:02:30,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 19:02:30,491 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,491 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,492 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 empty. 2023-09-19 19:02:30,492 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 empty. 2023-09-19 19:02:30,492 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,492 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,492 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-19 19:02:30,501 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-19 19:02:30,502 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1211874c5d346af44ca68377ba141136, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:30,503 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => abd054c9d92f677326210de6c49af0f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 1211874c5d346af44ca68377ba141136, disabling compactions & flushes 2023-09-19 19:02:30,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. after waiting 0 ms 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing abd054c9d92f677326210de6c49af0f5, disabling compactions & flushes 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 1211874c5d346af44ca68377ba141136: 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. after waiting 0 ms 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,512 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,512 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for abd054c9d92f677326210de6c49af0f5: 2023-09-19 19:02:30,514 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:02:30,515 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150150515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150150515"}]},"ts":"1695150150515"} 2023-09-19 19:02:30,515 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150150515"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150150515"}]},"ts":"1695150150515"} 2023-09-19 19:02:30,517 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:02:30,518 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:02:30,518 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150150518"}]},"ts":"1695150150518"} 2023-09-19 19:02:30,519 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-19 19:02:30,523 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:02:30,524 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:02:30,524 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:02:30,524 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:02:30,524 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:02:30,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, ASSIGN}] 2023-09-19 19:02:30,527 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, ASSIGN 2023-09-19 19:02:30,527 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, ASSIGN 2023-09-19 19:02:30,528 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:02:30,528 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42277,1695150075159; forceNewPlan=false, retain=false 2023-09-19 19:02:30,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 19:02:30,678 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:02:30,681 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=abd054c9d92f677326210de6c49af0f5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,681 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1211874c5d346af44ca68377ba141136, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,681 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150150681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150150681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150150681"}]},"ts":"1695150150681"} 2023-09-19 19:02:30,681 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150150681"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150150681"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150150681"}]},"ts":"1695150150681"} 2023-09-19 19:02:30,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure abd054c9d92f677326210de6c49af0f5, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:02:30,683 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 1211874c5d346af44ca68377ba141136, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:30,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 19:02:30,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => abd054c9d92f677326210de6c49af0f5, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.', STARTKEY => '2', ENDKEY => ''} 2023-09-19 19:02:30,838 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,838 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1211874c5d346af44ca68377ba141136, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.', STARTKEY => '', ENDKEY => '2'} 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. service=AccessControlService 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. service=AccessControlService 2023-09-19 19:02:30,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:30,839 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,840 INFO [StoreOpener-1211874c5d346af44ca68377ba141136-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,840 INFO [StoreOpener-abd054c9d92f677326210de6c49af0f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,842 DEBUG [StoreOpener-abd054c9d92f677326210de6c49af0f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf 2023-09-19 19:02:30,842 DEBUG [StoreOpener-abd054c9d92f677326210de6c49af0f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf 2023-09-19 19:02:30,842 DEBUG [StoreOpener-1211874c5d346af44ca68377ba141136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf 2023-09-19 19:02:30,842 DEBUG [StoreOpener-1211874c5d346af44ca68377ba141136-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf 2023-09-19 19:02:30,842 INFO [StoreOpener-abd054c9d92f677326210de6c49af0f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region abd054c9d92f677326210de6c49af0f5 columnFamilyName cf 2023-09-19 19:02:30,842 INFO [StoreOpener-1211874c5d346af44ca68377ba141136-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1211874c5d346af44ca68377ba141136 columnFamilyName cf 2023-09-19 19:02:30,843 INFO [StoreOpener-1211874c5d346af44ca68377ba141136-1] regionserver.HStore(310): Store=1211874c5d346af44ca68377ba141136/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:30,843 INFO [StoreOpener-abd054c9d92f677326210de6c49af0f5-1] regionserver.HStore(310): Store=abd054c9d92f677326210de6c49af0f5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:30,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:30,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:30,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:30,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:30,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1211874c5d346af44ca68377ba141136; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74392054, jitterRate=0.10852798819541931}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:30,849 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened abd054c9d92f677326210de6c49af0f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69196507, jitterRate=0.031108304858207703}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:30,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1211874c5d346af44ca68377ba141136: 2023-09-19 19:02:30,850 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for abd054c9d92f677326210de6c49af0f5: 2023-09-19 19:02:30,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136., pid=70, masterSystemTime=1695150150835 2023-09-19 19:02:30,850 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5., pid=69, masterSystemTime=1695150150834 2023-09-19 19:02:30,852 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,852 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:30,852 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1211874c5d346af44ca68377ba141136, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:30,853 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150150852"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150150852"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150150852"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150150852"}]},"ts":"1695150150852"} 2023-09-19 19:02:30,853 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,853 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:30,853 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=abd054c9d92f677326210de6c49af0f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:30,853 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150150853"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150150853"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150150853"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150150853"}]},"ts":"1695150150853"} 2023-09-19 19:02:30,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=67 2023-09-19 19:02:30,856 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 1211874c5d346af44ca68377ba141136, server=jenkins-hbase4.apache.org,42277,1695150075159 in 171 msec 2023-09-19 19:02:30,856 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=68 2023-09-19 19:02:30,857 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure abd054c9d92f677326210de6c49af0f5, server=jenkins-hbase4.apache.org,43479,1695150075067 in 172 msec 2023-09-19 19:02:30,857 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, ASSIGN in 332 msec 2023-09-19 19:02:30,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-19 19:02:30,858 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, ASSIGN in 333 msec 2023-09-19 19:02:30,859 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:02:30,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150150859"}]},"ts":"1695150150859"} 2023-09-19 19:02:30,860 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-19 19:02:30,863 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:02:30,863 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-19 19:02:30,865 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-19 19:02:30,867 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:30,867 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:30,867 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:30,867 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,869 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:30,870 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 382 msec 2023-09-19 19:02:31,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-19 19:02:31,093 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-19 19:02:31,114 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 1211874c5d346af44ca68377ba141136, abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:31,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1211874c5d346af44ca68377ba141136, abd054c9d92f677326210de6c49af0f5], force=true 2023-09-19 19:02:31,124 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1211874c5d346af44ca68377ba141136, abd054c9d92f677326210de6c49af0f5], force=true 2023-09-19 19:02:31,124 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1211874c5d346af44ca68377ba141136, abd054c9d92f677326210de6c49af0f5], force=true 2023-09-19 19:02:31,125 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1211874c5d346af44ca68377ba141136, abd054c9d92f677326210de6c49af0f5], force=true 2023-09-19 19:02:31,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 19:02:31,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, UNASSIGN}] 2023-09-19 19:02:31,148 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, UNASSIGN 2023-09-19 19:02:31,148 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, UNASSIGN 2023-09-19 19:02:31,149 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1211874c5d346af44ca68377ba141136, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:31,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=abd054c9d92f677326210de6c49af0f5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:31,149 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150151149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150151149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150151149"}]},"ts":"1695150151149"} 2023-09-19 19:02:31,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150151149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150151149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150151149"}]},"ts":"1695150151149"} 2023-09-19 19:02:31,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 1211874c5d346af44ca68377ba141136, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:31,152 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure abd054c9d92f677326210de6c49af0f5, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:02:31,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 19:02:31,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:31,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1211874c5d346af44ca68377ba141136, disabling compactions & flushes 2023-09-19 19:02:31,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:31,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:31,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. after waiting 0 ms 2023-09-19 19:02:31,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:31,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1211874c5d346af44ca68377ba141136 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-19 19:02:31,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:31,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing abd054c9d92f677326210de6c49af0f5, disabling compactions & flushes 2023-09-19 19:02:31,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:31,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:31,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. after waiting 0 ms 2023-09-19 19:02:31,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:31,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing abd054c9d92f677326210de6c49af0f5 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-19 19:02:31,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/.tmp/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5 2023-09-19 19:02:31,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/.tmp/cf/7166a32e51ef48158350a19fe80d995f 2023-09-19 19:02:31,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/.tmp/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5 2023-09-19 19:02:31,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/.tmp/cf/7166a32e51ef48158350a19fe80d995f as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf/7166a32e51ef48158350a19fe80d995f 2023-09-19 19:02:31,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5, entries=1, sequenceid=5, filesize=4.7 K 2023-09-19 19:02:31,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf/7166a32e51ef48158350a19fe80d995f, entries=1, sequenceid=5, filesize=4.7 K 2023-09-19 19:02:31,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for abd054c9d92f677326210de6c49af0f5 in 32ms, sequenceid=5, compaction requested=false 2023-09-19 19:02:31,339 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 1211874c5d346af44ca68377ba141136 in 34ms, sequenceid=5, compaction requested=false 2023-09-19 19:02:31,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 19:02:31,339 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 19:02:31,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-19 19:02:31,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-19 19:02:31,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:31,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136. 2023-09-19 19:02:31,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:31,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1211874c5d346af44ca68377ba141136: 2023-09-19 19:02:31,350 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5. 2023-09-19 19:02:31,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for abd054c9d92f677326210de6c49af0f5: 2023-09-19 19:02:31,351 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:31,351 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=abd054c9d92f677326210de6c49af0f5, regionState=CLOSED 2023-09-19 19:02:31,352 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150151351"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150151351"}]},"ts":"1695150151351"} 2023-09-19 19:02:31,352 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1211874c5d346af44ca68377ba141136 2023-09-19 19:02:31,352 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=1211874c5d346af44ca68377ba141136, regionState=CLOSED 2023-09-19 19:02:31,352 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695150151352"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150151352"}]},"ts":"1695150151352"} 2023-09-19 19:02:31,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-19 19:02:31,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure abd054c9d92f677326210de6c49af0f5, server=jenkins-hbase4.apache.org,43479,1695150075067 in 201 msec 2023-09-19 19:02:31,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-19 19:02:31,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 1211874c5d346af44ca68377ba141136, server=jenkins-hbase4.apache.org,42277,1695150075159 in 203 msec 2023-09-19 19:02:31,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=abd054c9d92f677326210de6c49af0f5, UNASSIGN in 209 msec 2023-09-19 19:02:31,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-19 19:02:31,357 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=1211874c5d346af44ca68377ba141136, UNASSIGN in 212 msec 2023-09-19 19:02:31,408 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-19 19:02:31,410 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150485.1211874c5d346af44ca68377ba141136.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:31,410 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695150150485.abd054c9d92f677326210de6c49af0f5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:31,410 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:31,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 19:02:31,460 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, ASSIGN}] 2023-09-19 19:02:31,461 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, ASSIGN 2023-09-19 19:02:31,461 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,42277,1695150075159; forceNewPlan=false, retain=false 2023-09-19 19:02:31,612 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-19 19:02:31,613 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e4aa6b811cda0340058bed24f4cc0e58, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:31,614 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695150151613"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150151613"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150151613"}]},"ts":"1695150151613"} 2023-09-19 19:02:31,616 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure e4aa6b811cda0340058bed24f4cc0e58, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:31,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 19:02:31,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e4aa6b811cda0340058bed24f4cc0e58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.', STARTKEY => '', ENDKEY => ''} 2023-09-19 19:02:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. service=AccessControlService 2023-09-19 19:02:31,771 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,772 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/.regioninfo 2023-09-19 19:02:31,782 INFO [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,783 DEBUG [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf 2023-09-19 19:02:31,783 DEBUG [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf 2023-09-19 19:02:31,783 INFO [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e4aa6b811cda0340058bed24f4cc0e58 columnFamilyName cf 2023-09-19 19:02:31,810 DEBUG [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] regionserver.HStore(539): loaded hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/7166a32e51ef48158350a19fe80d995f.1211874c5d346af44ca68377ba141136->hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf/7166a32e51ef48158350a19fe80d995f-top 2023-09-19 19:02:31,816 DEBUG [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] regionserver.HStore(539): loaded hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5.abd054c9d92f677326210de6c49af0f5->hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5-top 2023-09-19 19:02:31,816 INFO [StoreOpener-e4aa6b811cda0340058bed24f4cc0e58-1] regionserver.HStore(310): Store=e4aa6b811cda0340058bed24f4cc0e58/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:31,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:31,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e4aa6b811cda0340058bed24f4cc0e58; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59454455, jitterRate=-0.11405958235263824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:31,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e4aa6b811cda0340058bed24f4cc0e58: 2023-09-19 19:02:31,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58., pid=77, masterSystemTime=1695150151767 2023-09-19 19:02:31,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.,because compaction is disabled. 2023-09-19 19:02:31,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:31,825 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:31,825 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=e4aa6b811cda0340058bed24f4cc0e58, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:31,825 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695150151825"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150151825"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150151825"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150151825"}]},"ts":"1695150151825"} 2023-09-19 19:02:31,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-19 19:02:31,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure e4aa6b811cda0340058bed24f4cc0e58, server=jenkins-hbase4.apache.org,42277,1695150075159 in 212 msec 2023-09-19 19:02:31,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-19 19:02:31,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, ASSIGN in 368 msec 2023-09-19 19:02:31,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[1211874c5d346af44ca68377ba141136, abd054c9d92f677326210de6c49af0f5], force=true in 713 msec 2023-09-19 19:02:32,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-19 19:02:32,232 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-19 19:02:32,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 19:02:32,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150152233 (current time:1695150152233). 2023-09-19 19:02:32,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:32,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x4c70fa34 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:32,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30a47417, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:32,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:32,243 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:32,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4c70fa34 to 127.0.0.1:56787 2023-09-19 19:02:32,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:32,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x6a5c235c to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:32,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21b6c579, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:32,253 DEBUG [hconnection-0x32a11994-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:32,255 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:32,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a5c235c to 127.0.0.1:56787 2023-09-19 19:02:32,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:32,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-19 19:02:32,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:32,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 19:02:32,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 19:02:32,264 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 19:02:32,264 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695150752264 2023-09-19 19:02:32,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-19 19:02:32,264 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,268 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:32,268 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:32,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 19:02:32,269 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-19 19:02:32,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-19 19:02:32,271 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 19:02:32,271 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695150752271 2023-09-19 19:02:32,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,279 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-19 19:02:32,279 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:32,281 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-19 19:02:32,281 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-19 19:02:32,281 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,281 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,282 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:32,282 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:32,282 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:32,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:32,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:32,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:32,282 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,283 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,283 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,284 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 19:02:32,284 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 19:02:32,284 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:32,284 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-19 19:02:32,285 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 19:02:32,286 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:32,286 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 19:02:32,286 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 19:02:32,284 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 19:02:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-19 19:02:32,288 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 19:02:32,288 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 19:02:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-19 19:02:32,288 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-19 19:02:32,289 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,289 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:32,291 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,291 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:32,291 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,291 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:32,292 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,292 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:32,292 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,292 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:32,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-19 19:02:32,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f95cccb[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:32,294 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-19 19:02:32,294 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 19:02:32,295 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 19:02:32,295 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 19:02:32,295 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,295 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:32,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,295 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:32,295 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-19 19:02:32,295 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 19:02:32,296 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:32,296 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:32,296 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:32,296 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:32,296 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. started... 2023-09-19 19:02:32,297 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e4aa6b811cda0340058bed24f4cc0e58: 2023-09-19 19:02:32,297 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,297 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:32,297 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/7166a32e51ef48158350a19fe80d995f.1211874c5d346af44ca68377ba141136->hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf/7166a32e51ef48158350a19fe80d995f-top, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5.abd054c9d92f677326210de6c49af0f5->hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5-top] hfiles 2023-09-19 19:02:32,297 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/7166a32e51ef48158350a19fe80d995f.1211874c5d346af44ca68377ba141136 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,298 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5.abd054c9d92f677326210de6c49af0f5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,298 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 19:02:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 19:02:32,300 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 19:02:32,300 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:32,300 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 19:02:32,310 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. completed. 2023-09-19 19:02:32,310 DEBUG [rs(jenkins-hbase4.apache.org,42277,1695150075159)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-19 19:02:32,311 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:32,317 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-19 19:02:32,317 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,317 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:32,317 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-19 19:02:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:32,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:32,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:32,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,42277,1695150075159': 2023-09-19 19:02:32,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-19 19:02:32,320 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-19 19:02:32,320 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:32,320 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:32,320 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,320 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:32,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:32,322 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:32,323 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:32,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:32,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:32,323 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:32,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,325 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,325 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:32,325 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:32,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:32,329 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:32,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:32,329 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:32,329 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:32,329 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,328 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:32,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:32,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:32,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:32,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:32,329 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,330 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,353 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-19 19:02:32,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,353 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695150152265Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695150152329 (+64 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695150152329Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695150152332 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695150152344 (+12 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695150152353 (+9 ms) 2023-09-19 19:02:32,356 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-19 19:02:32,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 88 msec 2023-09-19 19:02:32,368 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:32,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-19 19:02:32,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:32,369 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369 2023-09-19 19:02:32,369 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37439, tgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369, rawTgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:32,391 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:32,391 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-696618317_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,391 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-19 19:02:32,400 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:32,419 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:32,419 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:32,420 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:32,420 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:32,994 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0004_000001 (auth:SIMPLE) 2023-09-19 19:02:33,303 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-6691166426423969019.jar 2023-09-19 19:02:33,304 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,304 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,370 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-2392422814736362370.jar 2023-09-19 19:02:33,371 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,371 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,372 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,372 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,372 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,373 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:02:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:02:33,374 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:02:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:02:33,375 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:02:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:02:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:02:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:02:33,376 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:02:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:02:33,377 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:33,378 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:33,378 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:33,379 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:33,379 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:33,379 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:33,380 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:33,743 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:02:33,746 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-19 19:02:33,748 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-19 19:02:33,804 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:33,804 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:33,981 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0005_000001 (auth:SIMPLE) 2023-09-19 19:02:34,396 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:02:37,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0005_000001 (auth:SIMPLE) 2023-09-19 19:02:40,017 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0005_000001 (auth:SIMPLE) 2023-09-19 19:02:42,412 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0005_000001 (auth:SIMPLE) 2023-09-19 19:02:44,007 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:02:44,008 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:02:44,016 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,016 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:02:44,016 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:02:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-19 19:02:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-19 19:02:44,017 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,018 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-19 19:02:44,018 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150152369/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-19 19:02:44,024 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 19:02:44,028 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150164028"}]},"ts":"1695150164028"} 2023-09-19 19:02:44,030 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-19 19:02:44,031 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-19 19:02:44,032 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, UNASSIGN}] 2023-09-19 19:02:44,034 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, UNASSIGN 2023-09-19 19:02:44,035 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e4aa6b811cda0340058bed24f4cc0e58, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:44,035 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695150164035"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150164035"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150164035"}]},"ts":"1695150164035"} 2023-09-19 19:02:44,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure e4aa6b811cda0340058bed24f4cc0e58, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:44,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 19:02:44,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:44,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e4aa6b811cda0340058bed24f4cc0e58, disabling compactions & flushes 2023-09-19 19:02:44,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:44,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:44,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. after waiting 0 ms 2023-09-19 19:02:44,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:44,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-19 19:02:44,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:44,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58. 2023-09-19 19:02:44,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e4aa6b811cda0340058bed24f4cc0e58: 2023-09-19 19:02:44,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:44,208 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=e4aa6b811cda0340058bed24f4cc0e58, regionState=CLOSED 2023-09-19 19:02:44,208 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695150164208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150164208"}]},"ts":"1695150164208"} 2023-09-19 19:02:44,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-19 19:02:44,211 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure e4aa6b811cda0340058bed24f4cc0e58, server=jenkins-hbase4.apache.org,42277,1695150075159 in 174 msec 2023-09-19 19:02:44,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-19 19:02:44,213 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=e4aa6b811cda0340058bed24f4cc0e58, UNASSIGN in 179 msec 2023-09-19 19:02:44,213 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150164213"}]},"ts":"1695150164213"} 2023-09-19 19:02:44,215 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-19 19:02:44,217 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-19 19:02:44,218 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 193 msec 2023-09-19 19:02:44,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-19 19:02:44,330 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-19 19:02:44,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,334 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,336 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,339 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:44,339 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 2023-09-19 19:02:44,339 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:44,339 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,339 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,340 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,340 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,341 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-19 19:02:44,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-19 19:02:44,341 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,341 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:02:44,341 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-19 19:02:44,341 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:02:44,341 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:02:44,341 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-19 19:02:44,341 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-19 19:02:44,341 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,341 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/recovered.edits] 2023-09-19 19:02:44,341 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/recovered.edits] 2023-09-19 19:02:44,341 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/recovered.edits] 2023-09-19 19:02:44,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:44,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:44,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-19 19:02:44,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:44,342 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:44,346 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5 2023-09-19 19:02:44,346 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/7166a32e51ef48158350a19fe80d995f.1211874c5d346af44ca68377ba141136 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/7166a32e51ef48158350a19fe80d995f.1211874c5d346af44ca68377ba141136 2023-09-19 19:02:44,346 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf/7166a32e51ef48158350a19fe80d995f to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/cf/7166a32e51ef48158350a19fe80d995f 2023-09-19 19:02:44,348 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5.abd054c9d92f677326210de6c49af0f5 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/cf/88a0d9bb01e645bdb6e1daaf2d9ff9e5.abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:44,349 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/recovered.edits/8.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5/recovered.edits/8.seqid 2023-09-19 19:02:44,350 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/recovered.edits/8.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136/recovered.edits/8.seqid 2023-09-19 19:02:44,350 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/abd054c9d92f677326210de6c49af0f5 2023-09-19 19:02:44,350 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/1211874c5d346af44ca68377ba141136 2023-09-19 19:02:44,351 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/recovered.edits/12.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58/recovered.edits/12.seqid 2023-09-19 19:02:44,351 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/e4aa6b811cda0340058bed24f4cc0e58 2023-09-19 19:02:44,351 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-19 19:02:44,354 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,356 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-19 19:02:44,358 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-19 19:02:44,359 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,359 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-19 19:02:44,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150164359"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:44,360 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-19 19:02:44,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e4aa6b811cda0340058bed24f4cc0e58, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695150150486.e4aa6b811cda0340058bed24f4cc0e58.', STARTKEY => '', ENDKEY => ''}] 2023-09-19 19:02:44,360 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-19 19:02:44,361 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150164360"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:44,362 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-19 19:02:44,364 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 33 msec 2023-09-19 19:02:44,443 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-19 19:02:44,444 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-19 19:02:44,444 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,444 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 19:02:44,449 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150164448"}]},"ts":"1695150164448"} 2023-09-19 19:02:44,450 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-19 19:02:44,451 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-19 19:02:44,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, UNASSIGN}] 2023-09-19 19:02:44,454 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, UNASSIGN 2023-09-19 19:02:44,454 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, UNASSIGN 2023-09-19 19:02:44,455 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=45c5169b6a624abd0ab0d3980155d79d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:44,455 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150164454"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150164454"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150164454"}]},"ts":"1695150164454"} 2023-09-19 19:02:44,455 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2fc345bddf482f98896b853b6169f76e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:44,455 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150164455"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150164455"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150164455"}]},"ts":"1695150164455"} 2023-09-19 19:02:44,456 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 45c5169b6a624abd0ab0d3980155d79d, server=jenkins-hbase4.apache.org,42277,1695150075159}] 2023-09-19 19:02:44,457 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 2fc345bddf482f98896b853b6169f76e, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:02:44,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 19:02:44,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:44,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 45c5169b6a624abd0ab0d3980155d79d, disabling compactions & flushes 2023-09-19 19:02:44,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:44,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:44,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. after waiting 0 ms 2023-09-19 19:02:44,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:44,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:44,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2fc345bddf482f98896b853b6169f76e, disabling compactions & flushes 2023-09-19 19:02:44,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:44,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:44,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. after waiting 0 ms 2023-09-19 19:02:44,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:44,619 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:02:44,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:44,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d. 2023-09-19 19:02:44,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:02:44,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 45c5169b6a624abd0ab0d3980155d79d: 2023-09-19 19:02:44,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:44,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e. 2023-09-19 19:02:44,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2fc345bddf482f98896b853b6169f76e: 2023-09-19 19:02:44,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:44,623 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=45c5169b6a624abd0ab0d3980155d79d, regionState=CLOSED 2023-09-19 19:02:44,623 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150164623"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150164623"}]},"ts":"1695150164623"} 2023-09-19 19:02:44,623 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:44,624 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=2fc345bddf482f98896b853b6169f76e, regionState=CLOSED 2023-09-19 19:02:44,624 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695150164624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150164624"}]},"ts":"1695150164624"} 2023-09-19 19:02:44,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-19 19:02:44,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 45c5169b6a624abd0ab0d3980155d79d, server=jenkins-hbase4.apache.org,42277,1695150075159 in 169 msec 2023-09-19 19:02:44,627 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-19 19:02:44,628 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 2fc345bddf482f98896b853b6169f76e, server=jenkins-hbase4.apache.org,39869,1695150075115 in 169 msec 2023-09-19 19:02:44,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=45c5169b6a624abd0ab0d3980155d79d, UNASSIGN in 174 msec 2023-09-19 19:02:44,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-19 19:02:44,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2fc345bddf482f98896b853b6169f76e, UNASSIGN in 175 msec 2023-09-19 19:02:44,629 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150164629"}]},"ts":"1695150164629"} 2023-09-19 19:02:44,631 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-19 19:02:44,633 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-19 19:02:44,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 190 msec 2023-09-19 19:02:44,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-19 19:02:44,751 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-19 19:02:44,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,754 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,755 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,756 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,759 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,759 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,759 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,759 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 19:02:44,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 19:02:44,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 19:02:44,759 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:44,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-19 19:02:44,759 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:44,760 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,760 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,760 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,760 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,761 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,760 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,761 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,760 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:44,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-19 19:02:44,762 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/recovered.edits] 2023-09-19 19:02:44,762 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/recovered.edits] 2023-09-19 19:02:44,766 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf/eca6234c83e4487b9e10a7421ab7169a to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/cf/eca6234c83e4487b9e10a7421ab7169a 2023-09-19 19:02:44,766 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf/030278111c8d45ceb5fab79a683881e1 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/cf/030278111c8d45ceb5fab79a683881e1 2023-09-19 19:02:44,769 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d/recovered.edits/9.seqid 2023-09-19 19:02:44,769 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e/recovered.edits/9.seqid 2023-09-19 19:02:44,769 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/45c5169b6a624abd0ab0d3980155d79d 2023-09-19 19:02:44,769 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2fc345bddf482f98896b853b6169f76e 2023-09-19 19:02:44,769 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-19 19:02:44,770 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-19 19:02:44,771 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-19 19:02:44,774 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230919c9da621ddcc24d58bf32608bc378ce87 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230919c9da621ddcc24d58bf32608bc378ce87 2023-09-19 19:02:44,775 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091925958d98200c43ab8d76cbbef33a3981 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e2023091925958d98200c43ab8d76cbbef33a3981 2023-09-19 19:02:44,775 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-19 19:02:44,778 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,780 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-19 19:02:44,781 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-19 19:02:44,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,782 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-19 19:02:44,783 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150164782"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:44,783 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150164782"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:44,784 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 19:02:44,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45c5169b6a624abd0ab0d3980155d79d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695150149118.45c5169b6a624abd0ab0d3980155d79d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2fc345bddf482f98896b853b6169f76e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695150149118.2fc345bddf482f98896b853b6169f76e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 19:02:44,784 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-19 19:02:44,784 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150164784"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:44,785 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-19 19:02:44,789 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,790 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 37 msec 2023-09-19 19:02:44,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-19 19:02:44,863 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-19 19:02:44,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-19 19:02:44,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-19 19:02:44,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-19 19:02:44,878 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-19 19:02:44,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-19 19:02:44,904 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 748) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:42566 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4077 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:53208 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1794287655_1 at /127.0.0.1:42540 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:38847 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:38648 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=908 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=208 (was 173) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=8847 (was 8885) 2023-09-19 19:02:44,904 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-19 19:02:44,923 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=908, MaxFileDescriptor=60000, SystemLoadAverage=208, ProcessCount=168, AvailableMemoryMB=8846 2023-09-19 19:02:44,923 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-09-19 19:02:44,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 19:02:44,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:44,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:02:44,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-19 19:02:44,928 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:02:44,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 19:02:44,931 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:44,931 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:44,931 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 empty. 2023-09-19 19:02:44,931 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b empty. 2023-09-19 19:02:44,932 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:44,932 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:44,932 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-19 19:02:44,941 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-19 19:02:44,942 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8fd43b2d8938d6d0f0d010c579d83f68, NAME => 'testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:44,942 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4a6b4c64f39223fb917973e46605415b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:44,957 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:44,957 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4a6b4c64f39223fb917973e46605415b, disabling compactions & flushes 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8fd43b2d8938d6d0f0d010c579d83f68, disabling compactions & flushes 2023-09-19 19:02:44,958 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:44,958 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. after waiting 0 ms 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. after waiting 0 ms 2023-09-19 19:02:44,958 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8fd43b2d8938d6d0f0d010c579d83f68: 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:44,958 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:44,958 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4a6b4c64f39223fb917973e46605415b: 2023-09-19 19:02:44,961 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:02:44,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150164961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150164961"}]},"ts":"1695150164961"} 2023-09-19 19:02:44,962 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150164961"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150164961"}]},"ts":"1695150164961"} 2023-09-19 19:02:44,963 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:02:44,964 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:02:44,964 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150164964"}]},"ts":"1695150164964"} 2023-09-19 19:02:44,965 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-19 19:02:44,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:02:44,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:02:44,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:02:44,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:02:44,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:02:44,970 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, ASSIGN}] 2023-09-19 19:02:44,972 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, ASSIGN 2023-09-19 19:02:44,972 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, ASSIGN 2023-09-19 19:02:44,973 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39869,1695150075115; forceNewPlan=false, retain=false 2023-09-19 19:02:44,973 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:02:45,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 19:02:45,123 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:02:45,126 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8fd43b2d8938d6d0f0d010c579d83f68, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4a6b4c64f39223fb917973e46605415b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,126 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150165126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150165126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150165126"}]},"ts":"1695150165126"} 2023-09-19 19:02:45,126 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150165126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150165126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150165126"}]},"ts":"1695150165126"} 2023-09-19 19:02:45,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 4a6b4c64f39223fb917973e46605415b, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:02:45,129 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 8fd43b2d8938d6d0f0d010c579d83f68, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:02:45,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 19:02:45,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4a6b4c64f39223fb917973e46605415b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. service=AccessControlService 2023-09-19 19:02:45,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8fd43b2d8938d6d0f0d010c579d83f68, NAME => 'testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 19:02:45,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. service=AccessControlService 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:45,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:45,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,290 INFO [StoreOpener-4a6b4c64f39223fb917973e46605415b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,291 INFO [StoreOpener-8fd43b2d8938d6d0f0d010c579d83f68-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,292 DEBUG [StoreOpener-4a6b4c64f39223fb917973e46605415b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf 2023-09-19 19:02:45,292 DEBUG [StoreOpener-8fd43b2d8938d6d0f0d010c579d83f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf 2023-09-19 19:02:45,292 DEBUG [StoreOpener-4a6b4c64f39223fb917973e46605415b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf 2023-09-19 19:02:45,292 DEBUG [StoreOpener-8fd43b2d8938d6d0f0d010c579d83f68-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf 2023-09-19 19:02:45,292 INFO [StoreOpener-8fd43b2d8938d6d0f0d010c579d83f68-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8fd43b2d8938d6d0f0d010c579d83f68 columnFamilyName cf 2023-09-19 19:02:45,292 INFO [StoreOpener-4a6b4c64f39223fb917973e46605415b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4a6b4c64f39223fb917973e46605415b columnFamilyName cf 2023-09-19 19:02:45,294 INFO [StoreOpener-4a6b4c64f39223fb917973e46605415b-1] regionserver.HStore(310): Store=4a6b4c64f39223fb917973e46605415b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:45,294 INFO [StoreOpener-8fd43b2d8938d6d0f0d010c579d83f68-1] regionserver.HStore(310): Store=8fd43b2d8938d6d0f0d010c579d83f68/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:45,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:45,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:45,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:45,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:45,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4a6b4c64f39223fb917973e46605415b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62358670, jitterRate=-0.07078340649604797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:45,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4a6b4c64f39223fb917973e46605415b: 2023-09-19 19:02:45,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8fd43b2d8938d6d0f0d010c579d83f68; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67434262, jitterRate=0.00484880805015564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:45,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8fd43b2d8938d6d0f0d010c579d83f68: 2023-09-19 19:02:45,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b., pid=93, masterSystemTime=1695150165280 2023-09-19 19:02:45,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68., pid=94, masterSystemTime=1695150165280 2023-09-19 19:02:45,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:45,303 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:45,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4a6b4c64f39223fb917973e46605415b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150165304"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150165304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150165304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150165304"}]},"ts":"1695150165304"} 2023-09-19 19:02:45,305 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8fd43b2d8938d6d0f0d010c579d83f68, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,305 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150165305"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150165305"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150165305"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150165305"}]},"ts":"1695150165305"} 2023-09-19 19:02:45,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-19 19:02:45,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 4a6b4c64f39223fb917973e46605415b, server=jenkins-hbase4.apache.org,39869,1695150075115 in 178 msec 2023-09-19 19:02:45,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-19 19:02:45,308 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 8fd43b2d8938d6d0f0d010c579d83f68, server=jenkins-hbase4.apache.org,43479,1695150075067 in 178 msec 2023-09-19 19:02:45,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, ASSIGN in 337 msec 2023-09-19 19:02:45,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=91, resume processing ppid=90 2023-09-19 19:02:45,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, ASSIGN in 338 msec 2023-09-19 19:02:45,310 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:02:45,310 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150165310"}]},"ts":"1695150165310"} 2023-09-19 19:02:45,312 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-19 19:02:45,314 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:02:45,314 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-19 19:02:45,316 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 19:02:45,318 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:45,318 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:45,318 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:45,318 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:45,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:45,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:45,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:45,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:45,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 394 msec 2023-09-19 19:02:45,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-19 19:02:45,533 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-19 19:02:45,535 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:45,535 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,537 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:02:45,548 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:02:45,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150165548 (current time:1695150165548). 2023-09-19 19:02:45,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:45,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x6a3c73c5 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:45,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@41e15d7d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:45,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:45,562 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41184, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:45,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a3c73c5 to 127.0.0.1:56787 2023-09-19 19:02:45,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:45,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x73b73425 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:45,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a1cd3cd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:45,572 DEBUG [hconnection-0x315d7346-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:45,573 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41190, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73b73425 to 127.0.0.1:56787 2023-09-19 19:02:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:45,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 19:02:45,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:45,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:02:45,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:02:45,582 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:02:45,583 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695150765583 2023-09-19 19:02:45,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:45,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:02:45,585 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:45,585 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:45,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 19:02:45,586 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:02:45,587 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-19 19:02:45,590 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 19:02:45,590 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695150765590 2023-09-19 19:02:45,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,599 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-19 19:02:45,599 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,600 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-19 19:02:45,601 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-19 19:02:45,601 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,601 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,607 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,607 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,607 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,607 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,607 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,607 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,608 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 19:02:45,608 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 19:02:45,609 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 19:02:45,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,609 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 19:02:45,609 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,609 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 19:02:45,609 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 19:02:45,609 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,609 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,610 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 19:02:45,609 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,611 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 19:02:45,611 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 19:02:45,612 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 19:02:45,612 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 19:02:45,612 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 19:02:45,612 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 19:02:45,612 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 19:02:45,612 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 19:02:45,614 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,614 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:45,615 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:45,615 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 19:02:45,617 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096131[Count = 1] remaining members to acquire global barrier 2023-09-19 19:02:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 19:02:45,620 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12096131[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:45,620 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 19:02:45,620 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,621 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,621 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,621 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:02:45,622 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:02:45,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,622 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:45,622 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. started... 2023-09-19 19:02:45,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,622 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,622 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:02:45,622 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd43b2d8938d6d0f0d010c579d83f68: 2023-09-19 19:02:45,622 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:45,623 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:45,623 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,623 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:45,623 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:45,623 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. started... 2023-09-19 19:02:45,623 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:02:45,624 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6b4c64f39223fb917973e46605415b: 2023-09-19 19:02:45,625 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,625 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 19:02:45,625 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:45,625 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:45,625 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:02:45,625 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 19:02:45,647 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. completed. 2023-09-19 19:02:45,647 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:45,647 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. completed. 2023-09-19 19:02:45,647 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,647 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:45,648 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 19:02:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 19:02:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:45,651 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 19:02:45,652 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,651 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:45,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,652 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 19:02:45,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:02:45,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:02:45,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 19:02:45,659 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-19 19:02:45,659 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:45,659 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:45,660 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,660 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:45,661 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:45,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,661 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:45,661 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,662 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:45,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,662 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:45,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,662 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:45,663 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,665 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,665 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,665 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:45,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,670 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:45,670 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:45,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:45,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:45,669 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:45,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,670 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:45,670 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,671 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,671 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:02:45,671 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,671 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,671 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,671 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,671 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:45,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:45,672 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 19:02:45,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,685 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:45,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:02:45,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:02:45,686 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:02:45,695 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,695 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-19 19:02:45,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,696 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695150165583Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695150165679 (+96 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695150165679Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695150165679Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695150165683 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695150165690 (+7 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695150165695 (+5 ms) 2023-09-19 19:02:45,699 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 19:02:45,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 115 msec 2023-09-19 19:02:45,886 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:45,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:02:45,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:45,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43479] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:02:45,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39869] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:02:45,893 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:45,893 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,894 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:02:45,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:02:45,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150165903 (current time:1695150165903). 2023-09-19 19:02:45,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:45,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x32be56c0 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:45,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6823c492, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:45,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:45,916 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41206, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:45,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x32be56c0 to 127.0.0.1:56787 2023-09-19 19:02:45,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:45,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x42608b61 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:45,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@228ddbb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:45,927 DEBUG [hconnection-0x74d98e38-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:45,930 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:45,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42608b61 to 127.0.0.1:56787 2023-09-19 19:02:45,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:45,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-19 19:02:45,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:45,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:02:45,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:02:45,939 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:02:45,940 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695150765940 2023-09-19 19:02:45,940 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:45,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-19 19:02:45,941 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:45,941 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:45,942 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 19:02:45,943 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-19 19:02:45,944 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-19 19:02:45,945 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 19:02:45,945 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695150765945 2023-09-19 19:02:45,957 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,957 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-19 19:02:45,957 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,959 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-19 19:02:45,959 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-19 19:02:45,959 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,959 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,962 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,962 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,962 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,962 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:45,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:45,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,963 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,963 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 19:02:45,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 19:02:45,964 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,964 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,964 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 19:02:45,964 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 19:02:45,964 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-19 19:02:45,966 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 19:02:45,966 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 19:02:45,964 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,966 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 19:02:45,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 19:02:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 19:02:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 19:02:45,967 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-19 19:02:45,967 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,967 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-19 19:02:45,968 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:45,972 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-19 19:02:45,973 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-19 19:02:45,973 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-19 19:02:45,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,974 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,974 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,974 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,974 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,974 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:45,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,975 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,975 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,976 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:45,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,976 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,976 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc7e438[Count = 1] remaining members to acquire global barrier 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:45,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:45,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:45,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-19 19:02:45,979 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2bc7e438[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:45,979 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-19 19:02:45,979 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:02:45,988 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:45,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,988 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:45,988 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:45,988 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:02:45,988 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:45,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:45,989 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. started... 2023-09-19 19:02:45,989 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:45,989 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:45,989 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-19 19:02:45,989 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:45,989 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:45,989 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. started... 2023-09-19 19:02:45,989 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4a6b4c64f39223fb917973e46605415b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-19 19:02:45,989 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:45,989 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 19:02:45,989 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8fd43b2d8938d6d0f0d010c579d83f68 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-19 19:02:45,989 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:45,991 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 19:02:45,991 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:45,991 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 19:02:46,007 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309192d42f2e2e5a741978796d4f48bf166f9 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309192d42f2e2e5a741978796d4f48bf166f9 2023-09-19 19:02:46,007 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919036922f8de77493a9447f6625e5678fc to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919036922f8de77493a9447f6625e5678fc 2023-09-19 19:02:46,018 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/.tmp/cf/8a5170cf46e744e5b9924adba397da05 2023-09-19 19:02:46,019 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/.tmp/cf/e066822cfdde42baadfb33a22317f456 2023-09-19 19:02:46,024 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/.tmp/cf/8a5170cf46e744e5b9924adba397da05 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf/8a5170cf46e744e5b9924adba397da05 2023-09-19 19:02:46,025 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/.tmp/cf/e066822cfdde42baadfb33a22317f456 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf/e066822cfdde42baadfb33a22317f456 2023-09-19 19:02:46,030 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf/e066822cfdde42baadfb33a22317f456, entries=46, sequenceid=6, filesize=12.9 K 2023-09-19 19:02:46,030 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf/8a5170cf46e744e5b9924adba397da05, entries=4, sequenceid=6, filesize=5.6 K 2023-09-19 19:02:46,031 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 4a6b4c64f39223fb917973e46605415b in 42ms, sequenceid=6, compaction requested=false 2023-09-19 19:02:46,031 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 8fd43b2d8938d6d0f0d010c579d83f68 in 42ms, sequenceid=6, compaction requested=false 2023-09-19 19:02:46,031 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-19 19:02:46,031 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-19 19:02:46,033 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4a6b4c64f39223fb917973e46605415b: 2023-09-19 19:02:46,033 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8fd43b2d8938d6d0f0d010c579d83f68: 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf/e066822cfdde42baadfb33a22317f456] hfiles 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf/8a5170cf46e744e5b9924adba397da05] hfiles 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf/e066822cfdde42baadfb33a22317f456 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,034 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf/8a5170cf46e744e5b9924adba397da05 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,042 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:46,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:02:46,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:02:46,043 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:02:46,050 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. completed. 2023-09-19 19:02:46,050 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:46,050 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:46,051 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. completed. 2023-09-19 19:02:46,051 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-19 19:02:46,051 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:46,052 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 19:02:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:46,052 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 19:02:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:46,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:46,055 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:46,055 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-19 19:02:46,055 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:46,055 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-19 19:02:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:46,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:02:46,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-19 19:02:46,062 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-19 19:02:46,062 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:46,062 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:46,062 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,062 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:46,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:46,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,065 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:46,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:46,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:46,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:46,065 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:46,066 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,067 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,068 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:46,068 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,070 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:46,070 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:46,071 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:46,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:46,070 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,071 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:46,071 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:46,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:46,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:46,071 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:46,071 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:46,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:46,070 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:46,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:46,071 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:46,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:46,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,073 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919036922f8de77493a9447f6625e5678fc, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309192d42f2e2e5a741978796d4f48bf166f9] mob files 2023-09-19 19:02:46,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919036922f8de77493a9447f6625e5678fc 2023-09-19 19:02:46,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309192d42f2e2e5a741978796d4f48bf166f9 2023-09-19 19:02:46,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,097 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-19 19:02:46,097 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,098 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695150165940Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695150166080 (+140 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695150166080Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695150166080Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695150166083 (+3 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695150166090 (+7 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695150166097 (+7 ms) 2023-09-19 19:02:46,103 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-19 19:02:46,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 162 msec 2023-09-19 19:02:46,243 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:46,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-19 19:02:46,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:46,244 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244 2023-09-19 19:02:46,244 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37439, tgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244, rawTgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:46,266 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:46,266 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2136484676_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,266 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-19 19:02:46,272 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:46,691 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:46,691 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:46,692 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:46,692 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,572 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-7508842537291749989.jar 2023-09-19 19:02:47,573 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,573 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,639 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-4091054954827038523.jar 2023-09-19 19:02:47,639 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,640 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,640 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,640 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,641 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,641 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:47,641 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:02:47,642 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:02:47,642 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:02:47,642 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:02:47,643 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:02:47,643 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:02:47,643 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:02:47,644 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:02:47,644 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:02:47,645 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:02:47,645 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:47,645 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:47,646 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:47,646 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:47,646 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:47,647 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:47,647 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:48,002 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:02:48,004 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-19 19:02:48,585 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:48,585 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:02:48,588 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0005_000001 (auth:SIMPLE) 2023-09-19 19:02:49,004 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0006_000001 (auth:SIMPLE) 2023-09-19 19:02:49,811 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:02:52,714 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0006_000001 (auth:SIMPLE) 2023-09-19 19:02:55,345 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:02:55,346 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:02:55,351 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:55,351 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:02:55,352 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:02:55,352 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:55,353 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-19 19:02:55,353 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-19 19:02:55,353 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:55,353 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-19 19:02:55,353 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150166244/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-19 19:02:55,357 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,358 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 19:02:55,362 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150175362"}]},"ts":"1695150175362"} 2023-09-19 19:02:55,363 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-19 19:02:55,365 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-19 19:02:55,365 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, UNASSIGN}] 2023-09-19 19:02:55,367 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, UNASSIGN 2023-09-19 19:02:55,367 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, UNASSIGN 2023-09-19 19:02:55,368 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8fd43b2d8938d6d0f0d010c579d83f68, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:55,368 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4a6b4c64f39223fb917973e46605415b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:55,368 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150175368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150175368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150175368"}]},"ts":"1695150175368"} 2023-09-19 19:02:55,368 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150175368"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150175368"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150175368"}]},"ts":"1695150175368"} 2023-09-19 19:02:55,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 8fd43b2d8938d6d0f0d010c579d83f68, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:02:55,370 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 4a6b4c64f39223fb917973e46605415b, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:02:55,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 19:02:55,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:55,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:55,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4a6b4c64f39223fb917973e46605415b, disabling compactions & flushes 2023-09-19 19:02:55,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8fd43b2d8938d6d0f0d010c579d83f68, disabling compactions & flushes 2023-09-19 19:02:55,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:55,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:55,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:55,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:55,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. after waiting 0 ms 2023-09-19 19:02:55,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:55,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. after waiting 0 ms 2023-09-19 19:02:55,522 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:55,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:02:55,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:02:55,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:55,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:02:55,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68. 2023-09-19 19:02:55,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8fd43b2d8938d6d0f0d010c579d83f68: 2023-09-19 19:02:55,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b. 2023-09-19 19:02:55,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4a6b4c64f39223fb917973e46605415b: 2023-09-19 19:02:55,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:55,533 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8fd43b2d8938d6d0f0d010c579d83f68, regionState=CLOSED 2023-09-19 19:02:55,533 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:55,533 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150175533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150175533"}]},"ts":"1695150175533"} 2023-09-19 19:02:55,533 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4a6b4c64f39223fb917973e46605415b, regionState=CLOSED 2023-09-19 19:02:55,534 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695150175533"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150175533"}]},"ts":"1695150175533"} 2023-09-19 19:02:55,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-19 19:02:55,536 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 8fd43b2d8938d6d0f0d010c579d83f68, server=jenkins-hbase4.apache.org,43479,1695150075067 in 165 msec 2023-09-19 19:02:55,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-19 19:02:55,537 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 4a6b4c64f39223fb917973e46605415b, server=jenkins-hbase4.apache.org,39869,1695150075115 in 165 msec 2023-09-19 19:02:55,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8fd43b2d8938d6d0f0d010c579d83f68, UNASSIGN in 171 msec 2023-09-19 19:02:55,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-19 19:02:55,538 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4a6b4c64f39223fb917973e46605415b, UNASSIGN in 172 msec 2023-09-19 19:02:55,538 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150175538"}]},"ts":"1695150175538"} 2023-09-19 19:02:55,539 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-19 19:02:55,541 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-19 19:02:55,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 183 msec 2023-09-19 19:02:55,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-19 19:02:55,664 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-19 19:02:55,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,668 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,668 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,670 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,672 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:55,672 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:55,673 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,673 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,673 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,673 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 19:02:55,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 19:02:55,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 19:02:55,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-19 19:02:55,675 DEBUG [HFileArchiver-17] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/recovered.edits] 2023-09-19 19:02:55,675 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/recovered.edits] 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:55,675 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:55,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-19 19:02:55,679 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf/8a5170cf46e744e5b9924adba397da05 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/cf/8a5170cf46e744e5b9924adba397da05 2023-09-19 19:02:55,679 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf/e066822cfdde42baadfb33a22317f456 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/cf/e066822cfdde42baadfb33a22317f456 2023-09-19 19:02:55,682 DEBUG [HFileArchiver-17] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68/recovered.edits/9.seqid 2023-09-19 19:02:55,682 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b/recovered.edits/9.seqid 2023-09-19 19:02:55,682 DEBUG [HFileArchiver-17] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/8fd43b2d8938d6d0f0d010c579d83f68 2023-09-19 19:02:55,682 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testEmptyExportFileSystemState/4a6b4c64f39223fb917973e46605415b 2023-09-19 19:02:55,682 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-19 19:02:55,683 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-19 19:02:55,684 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-19 19:02:55,687 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919036922f8de77493a9447f6625e5678fc to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230919036922f8de77493a9447f6625e5678fc 2023-09-19 19:02:55,688 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309192d42f2e2e5a741978796d4f48bf166f9 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202309192d42f2e2e5a741978796d4f48bf166f9 2023-09-19 19:02:55,688 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-19 19:02:55,690 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,692 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-19 19:02:55,694 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-19 19:02:55,695 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,695 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-19 19:02:55,696 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150175696"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:55,696 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150175696"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:55,697 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 19:02:55,698 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8fd43b2d8938d6d0f0d010c579d83f68, NAME => 'testtb-testEmptyExportFileSystemState,,1695150164924.8fd43b2d8938d6d0f0d010c579d83f68.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4a6b4c64f39223fb917973e46605415b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695150164924.4a6b4c64f39223fb917973e46605415b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 19:02:55,698 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-19 19:02:55,698 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150175698"}]},"ts":"9223372036854775807"} 2023-09-19 19:02:55,699 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-19 19:02:55,701 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-19 19:02:55,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 36 msec 2023-09-19 19:02:55,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-19 19:02:55,778 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-19 19:02:55,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-19 19:02:55,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:55,790 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-19 19:02:55,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-19 19:02:55,821 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=766 (was 759) Potentially hanging thread: Thread-4728 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:35851 from appattempt_1695150081669_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:42092 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:39364 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1527828346_1 at /127.0.0.1:33418 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:56746 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:41337 from appattempt_1695150081669_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:36611 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=942 (was 908) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=183 (was 208), ProcessCount=168 (was 168), AvailableMemoryMB=8803 (was 8846) 2023-09-19 19:02:55,821 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 19:02:55,844 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766, OpenFileDescriptor=942, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=168, AvailableMemoryMB=8802 2023-09-19 19:02:55,844 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-09-19 19:02:55,847 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-19 19:02:55,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:55,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-19 19:02:55,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-19 19:02:55,851 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-19 19:02:55,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 19:02:55,853 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:55,853 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:55,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d empty. 2023-09-19 19:02:55,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 empty. 2023-09-19 19:02:55,854 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:55,854 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:55,854 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-19 19:02:55,863 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-19 19:02:55,864 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b328ffe14e6ab17cbd591f6040682bc3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:55,864 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => e9173517801adbae353a5a8d589f528d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp 2023-09-19 19:02:55,881 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing e9173517801adbae353a5a8d589f528d, disabling compactions & flushes 2023-09-19 19:02:55,882 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. after waiting 0 ms 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:55,882 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for e9173517801adbae353a5a8d589f528d: 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b328ffe14e6ab17cbd591f6040682bc3, disabling compactions & flushes 2023-09-19 19:02:55,882 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. after waiting 0 ms 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:55,882 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:55,882 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b328ffe14e6ab17cbd591f6040682bc3: 2023-09-19 19:02:55,884 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-19 19:02:55,885 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150175885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150175885"}]},"ts":"1695150175885"} 2023-09-19 19:02:55,886 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150175885"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150175885"}]},"ts":"1695150175885"} 2023-09-19 19:02:55,888 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-19 19:02:55,889 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-19 19:02:55,889 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150175889"}]},"ts":"1695150175889"} 2023-09-19 19:02:55,890 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-19 19:02:55,894 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-19 19:02:55,896 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-19 19:02:55,896 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-19 19:02:55,896 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-19 19:02:55,896 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-19 19:02:55,896 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, ASSIGN}] 2023-09-19 19:02:55,898 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, ASSIGN 2023-09-19 19:02:55,899 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, ASSIGN 2023-09-19 19:02:55,899 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39869,1695150075115; forceNewPlan=false, retain=false 2023-09-19 19:02:55,899 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43479,1695150075067; forceNewPlan=false, retain=false 2023-09-19 19:02:55,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 19:02:56,049 INFO [jenkins-hbase4:33343] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-19 19:02:56,052 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e9173517801adbae353a5a8d589f528d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,052 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b328ffe14e6ab17cbd591f6040682bc3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,052 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150176052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150176052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150176052"}]},"ts":"1695150176052"} 2023-09-19 19:02:56,052 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150176052"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150176052"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150176052"}]},"ts":"1695150176052"} 2023-09-19 19:02:56,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure e9173517801adbae353a5a8d589f528d, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:02:56,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure b328ffe14e6ab17cbd591f6040682bc3, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:02:56,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 19:02:56,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e9173517801adbae353a5a8d589f528d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.', STARTKEY => '', ENDKEY => '1'} 2023-09-19 19:02:56,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b328ffe14e6ab17cbd591f6040682bc3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.', STARTKEY => '1', ENDKEY => ''} 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. service=AccessControlService 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. service=AccessControlService 2023-09-19 19:02:56,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:56,209 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:56,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-19 19:02:56,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,211 INFO [StoreOpener-e9173517801adbae353a5a8d589f528d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,211 INFO [StoreOpener-b328ffe14e6ab17cbd591f6040682bc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,212 DEBUG [StoreOpener-e9173517801adbae353a5a8d589f528d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf 2023-09-19 19:02:56,212 DEBUG [StoreOpener-b328ffe14e6ab17cbd591f6040682bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf 2023-09-19 19:02:56,212 DEBUG [StoreOpener-e9173517801adbae353a5a8d589f528d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf 2023-09-19 19:02:56,212 DEBUG [StoreOpener-b328ffe14e6ab17cbd591f6040682bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf 2023-09-19 19:02:56,212 INFO [StoreOpener-b328ffe14e6ab17cbd591f6040682bc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b328ffe14e6ab17cbd591f6040682bc3 columnFamilyName cf 2023-09-19 19:02:56,212 INFO [StoreOpener-e9173517801adbae353a5a8d589f528d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e9173517801adbae353a5a8d589f528d columnFamilyName cf 2023-09-19 19:02:56,214 INFO [StoreOpener-b328ffe14e6ab17cbd591f6040682bc3-1] regionserver.HStore(310): Store=b328ffe14e6ab17cbd591f6040682bc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:56,214 INFO [StoreOpener-e9173517801adbae353a5a8d589f528d-1] regionserver.HStore(310): Store=e9173517801adbae353a5a8d589f528d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-19 19:02:56,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e9173517801adbae353a5a8d589f528d 2023-09-19 19:02:56,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:02:56,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:56,219 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-19 19:02:56,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e9173517801adbae353a5a8d589f528d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73390658, jitterRate=0.09360602498054504}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:56,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e9173517801adbae353a5a8d589f528d: 2023-09-19 19:02:56,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b328ffe14e6ab17cbd591f6040682bc3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72025844, jitterRate=0.07326871156692505}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-19 19:02:56,220 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b328ffe14e6ab17cbd591f6040682bc3: 2023-09-19 19:02:56,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d., pid=108, masterSystemTime=1695150176206 2023-09-19 19:02:56,220 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3., pid=109, masterSystemTime=1695150176207 2023-09-19 19:02:56,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,222 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,222 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=e9173517801adbae353a5a8d589f528d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,222 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,223 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150176222"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150176222"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150176222"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150176222"}]},"ts":"1695150176222"} 2023-09-19 19:02:56,223 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,223 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b328ffe14e6ab17cbd591f6040682bc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,223 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150176223"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695150176223"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695150176223"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695150176223"}]},"ts":"1695150176223"} 2023-09-19 19:02:56,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-19 19:02:56,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure e9173517801adbae353a5a8d589f528d, server=jenkins-hbase4.apache.org,43479,1695150075067 in 170 msec 2023-09-19 19:02:56,226 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-19 19:02:56,226 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, ASSIGN in 329 msec 2023-09-19 19:02:56,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure b328ffe14e6ab17cbd591f6040682bc3, server=jenkins-hbase4.apache.org,39869,1695150075115 in 170 msec 2023-09-19 19:02:56,227 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-19 19:02:56,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, ASSIGN in 330 msec 2023-09-19 19:02:56,228 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-19 19:02:56,228 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150176228"}]},"ts":"1695150176228"} 2023-09-19 19:02:56,229 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-19 19:02:56,231 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-19 19:02:56,231 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-19 19:02:56,233 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 19:02:56,234 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:56,234 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:56,234 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:56,234 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:02:56,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:56,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:56,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:56,236 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-19 19:02:56,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 389 msec 2023-09-19 19:02:56,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-19 19:02:56,455 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-19 19:02:56,457 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,457 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,459 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:02:56,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 19:02:56,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150176468 (current time:1695150176468). 2023-09-19 19:02:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:56,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x590d5115 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:56,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66e510bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:56,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:56,479 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:56,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x590d5115 to 127.0.0.1:56787 2023-09-19 19:02:56,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:56,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x0d06458e to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:56,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3eb028c2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:56,487 DEBUG [hconnection-0x701e9767-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:56,490 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:56,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d06458e to 127.0.0.1:56787 2023-09-19 19:02:56,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:56,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 19:02:56,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:56,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 19:02:56,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 19:02:56,498 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 19:02:56,499 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695150776499 2023-09-19 19:02:56,499 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 19:02:56,499 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,500 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:56,500 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:56,501 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 19:02:56,501 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 19:02:56,502 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-19 19:02:56,503 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 19:02:56,504 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695150776504 2023-09-19 19:02:56,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,513 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-19 19:02:56,513 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,515 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-19 19:02:56,515 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-19 19:02:56,515 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,515 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,517 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,517 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,517 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,517 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,517 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,518 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,518 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,518 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,518 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,518 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,519 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 19:02:56,519 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,519 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,519 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 19:02:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 19:02:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 19:02:56,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 19:02:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 19:02:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,521 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,522 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 19:02:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 19:02:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 19:02:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 19:02:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 19:02:56,523 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 19:02:56,529 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,529 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,529 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,529 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,529 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,529 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,530 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:56,530 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,530 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:56,530 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,530 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2df955[Count = 1] remaining members to acquire global barrier 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 19:02:56,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c2df955[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:56,533 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-19 19:02:56,533 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,534 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,534 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,534 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 19:02:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:56,535 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 19:02:56,535 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. started... 2023-09-19 19:02:56,535 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,535 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:56,535 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9173517801adbae353a5a8d589f528d: 2023-09-19 19:02:56,535 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:56,535 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,535 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. started... 2023-09-19 19:02:56,536 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,536 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:56,537 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:02:56,537 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b328ffe14e6ab17cbd591f6040682bc3: 2023-09-19 19:02:56,537 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,537 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:56,537 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-19 19:02:56,539 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 19:02:56,539 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,539 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 19:02:56,552 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. completed. 2023-09-19 19:02:56,552 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,552 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. completed. 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:56,552 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 19:02:56,552 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 19:02:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,554 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,554 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 19:02:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,555 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 19:02:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,555 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 19:02:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:02:56,560 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-19 19:02:56,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:02:56,564 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-19 19:02:56,564 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-19 19:02:56,564 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:56,564 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:56,564 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,564 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,566 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,567 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,567 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,568 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,569 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,570 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,570 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,574 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,574 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,576 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,574 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,576 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,576 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:02:56,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,576 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,576 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,576 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-19 19:02:56,586 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,587 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,600 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:56,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 19:02:56,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:02:56,602 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:02:56,614 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-19 19:02:56,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,615 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695150176499Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695150176586 (+87 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695150176586Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695150176586Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695150176594 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695150176609 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695150176615 (+6 ms) 2023-09-19 19:02:56,618 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 19:02:56,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 118 msec 2023-09-19 19:02:56,802 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:56,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 19:02:56,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:56,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43479] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:02:56,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39869] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. with WAL disabled. Data may be lost in the event of a crash. 2023-09-19 19:02:56,808 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,808 DEBUG [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,809 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-19 19:02:56,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 19:02:56,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695150176817 (current time:1695150176817). 2023-09-19 19:02:56,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-19 19:02:56,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x64eaae7f to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:56,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60cba82a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:56,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:56,828 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43282, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:56,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64eaae7f to 127.0.0.1:56787 2023-09-19 19:02:56,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:56,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(139): Connect 0x77504598 to 127.0.0.1:56787 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-19 19:02:56,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f8945b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-19 19:02:56,836 DEBUG [hconnection-0x7bcffe56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-19 19:02:56,837 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-19 19:02:56,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77504598 to 127.0.0.1:56787 2023-09-19 19:02:56,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:02:56,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-19 19:02:56,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-19 19:02:56,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 19:02:56,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 19:02:56,845 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 19:02:56,846 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695150776846 2023-09-19 19:02:56,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-19 19:02:56,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,847 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-19 19:02:56,847 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-19 19:02:56,847 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 19:02:56,848 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-19 19:02:56,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-19 19:02:56,850 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 19:02:56,850 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695150776850 2023-09-19 19:02:56,858 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,858 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-19 19:02:56,858 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,859 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-19 19:02:56,859 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-19 19:02:56,859 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,859 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,861 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,861 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,861 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,861 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,861 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,862 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,862 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 19:02:56,862 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 19:02:56,863 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-19 19:02:56,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,863 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 19:02:56,863 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,864 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 19:02:56,864 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 19:02:56,864 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 19:02:56,864 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,863 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,865 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 19:02:56,865 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-19 19:02:56,865 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-19 19:02:56,864 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 19:02:56,866 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-19 19:02:56,866 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 19:02:56,866 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42277,1695150075159' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 19:02:56,865 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-19 19:02:56,866 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-19 19:02:56,867 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,867 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,868 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,868 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,868 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,868 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,868 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:56,868 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,868 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,869 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,869 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-19 19:02:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43479,1695150075067' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5f998f[Count = 1] remaining members to acquire global barrier 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39869,1695150075115' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-19 19:02:56,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d5f998f[Count = 0] remaining members to acquire global barrier 2023-09-19 19:02:56,872 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-19 19:02:56,872 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 19:02:56,881 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:56,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,881 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-19 19:02:56,881 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-19 19:02:56,882 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-19 19:02:56,882 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,882 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-19 19:02:56,881 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. started... 2023-09-19 19:02:56,881 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 19:02:56,881 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. started... 2023-09-19 19:02:56,882 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42277,1695150075159' in zk 2023-09-19 19:02:56,882 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b328ffe14e6ab17cbd591f6040682bc3 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-19 19:02:56,882 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e9173517801adbae353a5a8d589f528d 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-19 19:02:56,883 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 19:02:56,883 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,884 DEBUG [member: 'jenkins-hbase4.apache.org,42277,1695150075159' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 19:02:56,902 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230919b36960831bf74ef78466a124045f9481 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919b36960831bf74ef78466a124045f9481 2023-09-19 19:02:56,902 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091916fd36d7b7e84eb1b44d6703d6eb0768 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091916fd36d7b7e84eb1b44d6703d6eb0768 2023-09-19 19:02:56,913 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/.tmp/cf/97810ad6c8aa4305aa2d222fcaf08019 2023-09-19 19:02:56,914 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/.tmp/cf/69dd61a3ee8d4757bb64e9721874bd6c 2023-09-19 19:02:56,918 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/.tmp/cf/69dd61a3ee8d4757bb64e9721874bd6c as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf/69dd61a3ee8d4757bb64e9721874bd6c 2023-09-19 19:02:56,918 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/.tmp/cf/97810ad6c8aa4305aa2d222fcaf08019 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf/97810ad6c8aa4305aa2d222fcaf08019 2023-09-19 19:02:56,922 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf/69dd61a3ee8d4757bb64e9721874bd6c, entries=48, sequenceid=6, filesize=13.5 K 2023-09-19 19:02:56,923 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf/97810ad6c8aa4305aa2d222fcaf08019, entries=2, sequenceid=6, filesize=5.2 K 2023-09-19 19:02:56,923 INFO [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for b328ffe14e6ab17cbd591f6040682bc3 in 41ms, sequenceid=6, compaction requested=false 2023-09-19 19:02:56,923 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-19 19:02:56,924 INFO [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for e9173517801adbae353a5a8d589f528d in 42ms, sequenceid=6, compaction requested=false 2023-09-19 19:02:56,924 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b328ffe14e6ab17cbd591f6040682bc3: 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e9173517801adbae353a5a8d589f528d: 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf/69dd61a3ee8d4757bb64e9721874bd6c] hfiles 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf/97810ad6c8aa4305aa2d222fcaf08019] hfiles 2023-09-19 19:02:56,926 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf/97810ad6c8aa4305aa2d222fcaf08019 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,925 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf/69dd61a3ee8d4757bb64e9721874bd6c for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,940 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. completed. 2023-09-19 19:02:56,941 DEBUG [rs(jenkins-hbase4.apache.org,43479,1695150075067)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,941 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. completed. 2023-09-19 19:02:56,941 DEBUG [rs(jenkins-hbase4.apache.org,39869,1695150075115)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43479,1695150075067' in zk 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-19 19:02:56,941 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39869,1695150075115' in zk 2023-09-19 19:02:56,943 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,943 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 19:02:56,943 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,943 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-19 19:02:56,943 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,943 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,943 DEBUG [member: 'jenkins-hbase4.apache.org,43479,1695150075067' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 19:02:56,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,943 DEBUG [member: 'jenkins-hbase4.apache.org,39869,1695150075115' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-19 19:02:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39869,1695150075115': 2023-09-19 19:02:56,947 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39869,1695150075115' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-19 19:02:56,947 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:56,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 19:02:56,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-19 19:02:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,949 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-19 19:02:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43479,1695150075067': 2023-09-19 19:02:56,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43479,1695150075067' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-19 19:02:56,951 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-19 19:02:56,951 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-19 19:02:56,951 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-19 19:02:56,951 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,951 INFO [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-19 19:02:56,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-19 19:02:56,953 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,953 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,954 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-19 19:02:56,954 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-19 19:02:56,956 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,956 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,956 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-19 19:02:56,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,959 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,959 DEBUG [(jenkins-hbase4.apache.org,33343,1695150073780)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-19 19:02:56,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,959 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:02:56,959 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-19 19:02:56,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-19 19:02:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-19 19:02:56,961 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,961 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:02:56,961 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:02:56,961 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-19 19:02:56,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-19 19:02:56,961 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919b36960831bf74ef78466a124045f9481, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091916fd36d7b7e84eb1b44d6703d6eb0768] mob files 2023-09-19 19:02:56,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919b36960831bf74ef78466a124045f9481 2023-09-19 19:02:56,962 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091916fd36d7b7e84eb1b44d6703d6eb0768 2023-09-19 19:02:56,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,968 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,984 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-19 19:02:56,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,984 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:56,984 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695150176846Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695150176968 (+122 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695150176968Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695150176968Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695150176971 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695150176977 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695150176984 (+7 ms) 2023-09-19 19:02:56,987 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-19 19:02:56,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 140 msec 2023-09-19 19:02:57,149 DEBUG [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-19 19:02:57,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-19 19:02:57,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-19 19:02:57,150 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150 2023-09-19 19:02:57,150 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:37439, tgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150, rawTgtDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150, srcFsUri=hdfs://localhost:37439, srcDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:57,172 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37 2023-09-19 19:02:57,172 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1841126952_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:57,172 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:37439, inputRoot=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37, snapshotDir=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-19 19:02:57,180 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:02:57,194 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:57,195 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:57,195 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:57,195 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,066 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-8415388155456946931.jar 2023-09-19 19:02:58,067 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,067 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,133 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/hadoop-5531344335232747321.jar 2023-09-19 19:02:58,134 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,134 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,135 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,135 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,136 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,136 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-19 19:02:58,136 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-19 19:02:58,137 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-19 19:02:58,137 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-19 19:02:58,137 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-19 19:02:58,137 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-19 19:02:58,138 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-19 19:02:58,138 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-19 19:02:58,139 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-19 19:02:58,139 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-19 19:02:58,140 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-19 19:02:58,140 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:58,140 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:58,141 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:58,141 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:58,141 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-19 19:02:58,142 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:58,142 DEBUG [Listener at jenkins-hbase4.apache.org/34965] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-19 19:02:58,507 WARN [Listener at jenkins-hbase4.apache.org/34965] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-19 19:02:58,510 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-19 19:02:58,512 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-19 19:03:00,037 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:03:00,037 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-19 19:03:00,043 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0006_000001 (auth:SIMPLE) 2023-09-19 19:03:00,606 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0007_000001 (auth:SIMPLE) 2023-09-19 19:03:01,114 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:03:04,316 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0007_000001 (auth:SIMPLE) 2023-09-19 19:03:06,525 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0007_000001 (auth:SIMPLE) 2023-09-19 19:03:09,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695150081669_0007_000001 (auth:SIMPLE) 2023-09-19 19:03:10,676 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-19 19:03:10,676 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-19 19:03:10,687 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:10,687 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-19 19:03:10,688 INFO [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-19 19:03:10,688 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:10,688 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-19 19:03:10,689 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-19 19:03:10,689 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1101507864_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:10,689 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-19 19:03:10,689 DEBUG [Listener at jenkins-hbase4.apache.org/34965] snapshot.TestExportSnapshot(367): hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/export-test/export-1695150177150/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-19 19:03:10,695 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:10,696 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:10,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 19:03:10,700 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150190700"}]},"ts":"1695150190700"} 2023-09-19 19:03:10,701 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-19 19:03:10,703 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-19 19:03:10,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, UNASSIGN}] 2023-09-19 19:03:10,705 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, UNASSIGN 2023-09-19 19:03:10,705 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, UNASSIGN 2023-09-19 19:03:10,706 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b328ffe14e6ab17cbd591f6040682bc3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:03:10,706 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e9173517801adbae353a5a8d589f528d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:03:10,706 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150190706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150190706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150190706"}]},"ts":"1695150190706"} 2023-09-19 19:03:10,706 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150190706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695150190706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695150190706"}]},"ts":"1695150190706"} 2023-09-19 19:03:10,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure b328ffe14e6ab17cbd591f6040682bc3, server=jenkins-hbase4.apache.org,39869,1695150075115}] 2023-09-19 19:03:10,708 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure e9173517801adbae353a5a8d589f528d, server=jenkins-hbase4.apache.org,43479,1695150075067}] 2023-09-19 19:03:10,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 19:03:10,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:03:10,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b328ffe14e6ab17cbd591f6040682bc3, disabling compactions & flushes 2023-09-19 19:03:10,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:03:10,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:03:10,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. after waiting 0 ms 2023-09-19 19:03:10,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:03:10,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e9173517801adbae353a5a8d589f528d 2023-09-19 19:03:10,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e9173517801adbae353a5a8d589f528d, disabling compactions & flushes 2023-09-19 19:03:10,863 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:03:10,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:03:10,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. after waiting 0 ms 2023-09-19 19:03:10,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:03:10,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:03:10,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:03:10,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:10,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3. 2023-09-19 19:03:10,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b328ffe14e6ab17cbd591f6040682bc3: 2023-09-19 19:03:10,872 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:10,873 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d. 2023-09-19 19:03:10,873 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e9173517801adbae353a5a8d589f528d: 2023-09-19 19:03:10,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:03:10,874 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b328ffe14e6ab17cbd591f6040682bc3, regionState=CLOSED 2023-09-19 19:03:10,874 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150190874"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150190874"}]},"ts":"1695150190874"} 2023-09-19 19:03:10,874 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e9173517801adbae353a5a8d589f528d 2023-09-19 19:03:10,875 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=e9173517801adbae353a5a8d589f528d, regionState=CLOSED 2023-09-19 19:03:10,875 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695150190875"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695150190875"}]},"ts":"1695150190875"} 2023-09-19 19:03:10,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-09-19 19:03:10,877 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure b328ffe14e6ab17cbd591f6040682bc3, server=jenkins-hbase4.apache.org,39869,1695150075115 in 168 msec 2023-09-19 19:03:10,877 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=115 2023-09-19 19:03:10,878 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure e9173517801adbae353a5a8d589f528d, server=jenkins-hbase4.apache.org,43479,1695150075067 in 168 msec 2023-09-19 19:03:10,878 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b328ffe14e6ab17cbd591f6040682bc3, UNASSIGN in 174 msec 2023-09-19 19:03:10,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-19 19:03:10,879 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=e9173517801adbae353a5a8d589f528d, UNASSIGN in 175 msec 2023-09-19 19:03:10,880 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695150190879"}]},"ts":"1695150190879"} 2023-09-19 19:03:10,880 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-19 19:03:10,883 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-19 19:03:10,884 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 187 msec 2023-09-19 19:03:11,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-19 19:03:11,002 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-19 19:03:11,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,006 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,006 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,008 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43479] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,010 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,010 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,010 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,010 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,010 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d 2023-09-19 19:03:11,010 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:03:11,011 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 19:03:11,011 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 19:03:11,011 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 19:03:11,011 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,011 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:03:11,012 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-19 19:03:11,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-19 19:03:11,013 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/recovered.edits] 2023-09-19 19:03:11,013 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf, FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/recovered.edits] 2023-09-19 19:03:11,016 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf/97810ad6c8aa4305aa2d222fcaf08019 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/cf/97810ad6c8aa4305aa2d222fcaf08019 2023-09-19 19:03:11,016 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf/69dd61a3ee8d4757bb64e9721874bd6c to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/cf/69dd61a3ee8d4757bb64e9721874bd6c 2023-09-19 19:03:11,019 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d/recovered.edits/9.seqid 2023-09-19 19:03:11,019 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/recovered.edits/9.seqid to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3/recovered.edits/9.seqid 2023-09-19 19:03:11,019 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9173517801adbae353a5a8d589f528d 2023-09-19 19:03:11,019 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b328ffe14e6ab17cbd591f6040682bc3 2023-09-19 19:03:11,019 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-19 19:03:11,020 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-19 19:03:11,020 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-19 19:03:11,024 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919b36960831bf74ef78466a124045f9481 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230919b36960831bf74ef78466a124045f9481 2023-09-19 19:03:11,025 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091916fd36d7b7e84eb1b44d6703d6eb0768 to hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e2023091916fd36d7b7e84eb1b44d6703d6eb0768 2023-09-19 19:03:11,025 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-19 19:03:11,027 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,028 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-19 19:03:11,030 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-19 19:03:11,031 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,031 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-19 19:03:11,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150191031"}]},"ts":"9223372036854775807"} 2023-09-19 19:03:11,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695150191031"}]},"ts":"9223372036854775807"} 2023-09-19 19:03:11,033 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-19 19:03:11,033 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e9173517801adbae353a5a8d589f528d, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695150175846.e9173517801adbae353a5a8d589f528d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b328ffe14e6ab17cbd591f6040682bc3, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695150175846.b328ffe14e6ab17cbd591f6040682bc3.', STARTKEY => '1', ENDKEY => ''}] 2023-09-19 19:03:11,033 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-19 19:03:11,033 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695150191033"}]},"ts":"9223372036854775807"} 2023-09-19 19:03:11,034 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-19 19:03:11,037 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,038 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 34 msec 2023-09-19 19:03:11,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-19 19:03:11,114 INFO [Listener at jenkins-hbase4.apache.org/34965] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-19 19:03:11,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-19 19:03:11,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-19 19:03:11,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33343] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-19 19:03:11,149 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=767 (was 766) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:40746 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:54102 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5336 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_750525162_1 at /127.0.0.1:40218 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1354340851) connection to jenkins-hbase4.apache.org/172.31.14.131:43511 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x39ebf408-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_750525162_1 at /127.0.0.1:40734 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1101507864_17 at /127.0.0.1:40260 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=911 (was 942), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 183), ProcessCount=168 (was 168), AvailableMemoryMB=8755 (was 8802) 2023-09-19 19:03:11,150 WARN [Listener at jenkins-hbase4.apache.org/34965] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-19 19:03:11,150 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-19 19:03:11,162 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 19:03:11,273 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695150081669_0007_01_000001 is : 143 2023-09-19 19:03:16,437 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-19 19:03:25,292 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 19:03:39,412 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 19:03:39,413 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 19:03:39,522 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-19 19:03:39,531 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-19 19:03:39,532 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 19:03:39,544 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-19 19:03:39,648 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-19 19:03:39,648 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-19 19:03:39,648 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-19 19:03:39,648 INFO [Listener at jenkins-hbase4.apache.org/34965] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-19 19:03:39,648 DEBUG [Listener at jenkins-hbase4.apache.org/34965] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51038fe2 to 127.0.0.1:56787 2023-09-19 19:03:39,648 DEBUG [Listener at jenkins-hbase4.apache.org/34965] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,649 DEBUG [Listener at jenkins-hbase4.apache.org/34965] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-19 19:03:39,649 DEBUG [Listener at jenkins-hbase4.apache.org/34965] util.JVMClusterUtil(257): Found active master hash=966424527, stopped=false 2023-09-19 19:03:39,649 DEBUG [Listener at jenkins-hbase4.apache.org/34965] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,649 DEBUG [Listener at jenkins-hbase4.apache.org/34965] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-19 19:03:39,649 INFO [Listener at jenkins-hbase4.apache.org/34965] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:03:39,651 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 19:03:39,651 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 19:03:39,651 INFO [Listener at jenkins-hbase4.apache.org/34965] procedure2.ProcedureExecutor(628): Stopping 2023-09-19 19:03:39,651 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 19:03:39,651 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:03:39,651 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-19 19:03:39,651 DEBUG [Listener at jenkins-hbase4.apache.org/34965] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5922cdf5 to 127.0.0.1:56787 2023-09-19 19:03:39,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:03:39,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:03:39,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:03:39,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-19 19:03:39,651 DEBUG [Listener at jenkins-hbase4.apache.org/34965] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,652 INFO [Listener at jenkins-hbase4.apache.org/34965] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43479,1695150075067' ***** 2023-09-19 19:03:39,652 DEBUG [Listener at jenkins-hbase4.apache.org/34965] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,652 INFO [Listener at jenkins-hbase4.apache.org/34965] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 19:03:39,652 INFO [Listener at jenkins-hbase4.apache.org/34965] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39869,1695150075115' ***** 2023-09-19 19:03:39,652 DEBUG [Listener at jenkins-hbase4.apache.org/34965] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,652 INFO [RS:0;jenkins-hbase4:43479] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 19:03:39,652 INFO [Listener at jenkins-hbase4.apache.org/34965] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 19:03:39,652 INFO [Listener at jenkins-hbase4.apache.org/34965] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42277,1695150075159' ***** 2023-09-19 19:03:39,652 INFO [RS:0;jenkins-hbase4:43479] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 19:03:39,652 DEBUG [Listener at jenkins-hbase4.apache.org/34965] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,652 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 19:03:39,652 INFO [RS:0;jenkins-hbase4:43479] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 19:03:39,652 INFO [RS:1;jenkins-hbase4:39869] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 19:03:39,652 INFO [Listener at jenkins-hbase4.apache.org/34965] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-19 19:03:39,653 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 19:03:39,653 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(3305): Received CLOSE for 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:03:39,653 INFO [RS:1;jenkins-hbase4:39869] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 19:03:39,653 INFO [RS:2;jenkins-hbase4:42277] regionserver.HeapMemoryManager(220): Stopping 2023-09-19 19:03:39,653 INFO [RS:1;jenkins-hbase4:39869] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 19:03:39,653 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-19 19:03:39,653 INFO [RS:2;jenkins-hbase4:42277] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-19 19:03:39,653 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:03:39,653 INFO [RS:2;jenkins-hbase4:42277] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-19 19:03:39,653 DEBUG [RS:0;jenkins-hbase4:43479] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7dad7058 to 127.0.0.1:56787 2023-09-19 19:03:39,653 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(3305): Received CLOSE for c93154be637ce47f70873b2989967c25 2023-09-19 19:03:39,654 DEBUG [RS:0;jenkins-hbase4:43479] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,653 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:03:39,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3dadf8876ef64551c42743f77f3e4f5a, disabling compactions & flushes 2023-09-19 19:03:39,655 DEBUG [RS:2;jenkins-hbase4:42277] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2ba88a3d to 127.0.0.1:56787 2023-09-19 19:03:39,655 INFO [RS:0;jenkins-hbase4:43479] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 19:03:39,655 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:03:39,656 INFO [RS:0;jenkins-hbase4:43479] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 19:03:39,656 DEBUG [RS:1;jenkins-hbase4:39869] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a0467bd to 127.0.0.1:56787 2023-09-19 19:03:39,656 DEBUG [RS:2;jenkins-hbase4:42277] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:03:39,658 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42277,1695150075159; all regions closed. 2023-09-19 19:03:39,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:03:39,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c93154be637ce47f70873b2989967c25, disabling compactions & flushes 2023-09-19 19:03:39,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. after waiting 0 ms 2023-09-19 19:03:39,658 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:03:39,656 DEBUG [RS:1;jenkins-hbase4:39869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,656 INFO [RS:0;jenkins-hbase4:43479] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 19:03:39,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:03:39,658 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:03:39,659 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-19 19:03:39,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. after waiting 0 ms 2023-09-19 19:03:39,659 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-19 19:03:39,659 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:03:39,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3dadf8876ef64551c42743f77f3e4f5a 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-19 19:03:39,659 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-19 19:03:39,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c93154be637ce47f70873b2989967c25 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-19 19:03:39,659 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1478): Online Regions={3dadf8876ef64551c42743f77f3e4f5a=hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a., 1588230740=hbase:meta,,1.1588230740} 2023-09-19 19:03:39,659 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1478): Online Regions={c93154be637ce47f70873b2989967c25=hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25.} 2023-09-19 19:03:39,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-19 19:03:39,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-19 19:03:39,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-19 19:03:39,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-19 19:03:39,660 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-19 19:03:39,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-19 19:03:39,661 DEBUG [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1504): Waiting on c93154be637ce47f70873b2989967c25 2023-09-19 19:03:39,661 DEBUG [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1504): Waiting on 1588230740, 3dadf8876ef64551c42743f77f3e4f5a 2023-09-19 19:03:39,674 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-19 19:03:39,674 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-19 19:03:39,676 DEBUG [RS:2;jenkins-hbase4:42277] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs 2023-09-19 19:03:39,676 INFO [RS:2;jenkins-hbase4:42277] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42277%2C1695150075159:(num 1695150076815) 2023-09-19 19:03:39,676 DEBUG [RS:2;jenkins-hbase4:42277] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,676 INFO [RS:2;jenkins-hbase4:42277] regionserver.LeaseManager(133): Closed leases 2023-09-19 19:03:39,678 INFO [RS:2;jenkins-hbase4:42277] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-19 19:03:39,678 INFO [RS:2;jenkins-hbase4:42277] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 19:03:39,678 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 19:03:39,678 INFO [RS:2;jenkins-hbase4:42277] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 19:03:39,679 INFO [RS:2;jenkins-hbase4:42277] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 19:03:39,685 INFO [RS:2;jenkins-hbase4:42277] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42277 2023-09-19 19:03:39,694 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 19:03:39,697 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 19:03:39,697 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-19 19:03:39,697 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/.tmp/info/a15ed85cdca547d59499db6ad6066c94 2023-09-19 19:03:39,700 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:03:39,701 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:03:39,701 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:03:39,701 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:03:39,701 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:03:39,701 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42277,1695150075159 2023-09-19 19:03:39,701 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:03:39,702 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42277,1695150075159] 2023-09-19 19:03:39,704 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42277,1695150075159; numProcessing=1 2023-09-19 19:03:39,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/.tmp/info/bdb680dd4d4240ef96c7bd380c3c4e5d 2023-09-19 19:03:39,706 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42277,1695150075159 already deleted, retry=false 2023-09-19 19:03:39,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/.tmp/l/23569c7097f64ded87371607c1289240 2023-09-19 19:03:39,706 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42277,1695150075159 expired; onlineServers=2 2023-09-19 19:03:39,709 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-19 19:03:39,709 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-19 19:03:39,710 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a15ed85cdca547d59499db6ad6066c94 2023-09-19 19:03:39,711 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23569c7097f64ded87371607c1289240 2023-09-19 19:03:39,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/.tmp/info/bdb680dd4d4240ef96c7bd380c3c4e5d as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/info/bdb680dd4d4240ef96c7bd380c3c4e5d 2023-09-19 19:03:39,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/.tmp/l/23569c7097f64ded87371607c1289240 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/l/23569c7097f64ded87371607c1289240 2023-09-19 19:03:39,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/info/bdb680dd4d4240ef96c7bd380c3c4e5d, entries=2, sequenceid=6, filesize=4.8 K 2023-09-19 19:03:39,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for c93154be637ce47f70873b2989967c25 in 59ms, sequenceid=6, compaction requested=false 2023-09-19 19:03:39,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 23569c7097f64ded87371607c1289240 2023-09-19 19:03:39,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/l/23569c7097f64ded87371607c1289240, entries=7, sequenceid=18, filesize=5.2 K 2023-09-19 19:03:39,720 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 3dadf8876ef64551c42743f77f3e4f5a in 61ms, sequenceid=18, compaction requested=false 2023-09-19 19:03:39,729 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/.tmp/rep_barrier/97bcee2af6e54ab2aff6e2e950ea0a2d 2023-09-19 19:03:39,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/namespace/c93154be637ce47f70873b2989967c25/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-19 19:03:39,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/acl/3dadf8876ef64551c42743f77f3e4f5a/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-19 19:03:39,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,731 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:03:39,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c93154be637ce47f70873b2989967c25: 2023-09-19 19:03:39,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695150077272.c93154be637ce47f70873b2989967c25. 2023-09-19 19:03:39,731 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:03:39,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3dadf8876ef64551c42743f77f3e4f5a: 2023-09-19 19:03:39,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695150078018.3dadf8876ef64551c42743f77f3e4f5a. 2023-09-19 19:03:39,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97bcee2af6e54ab2aff6e2e950ea0a2d 2023-09-19 19:03:39,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/.tmp/table/0a142346a98b4598b6c393ef50456a26 2023-09-19 19:03:39,749 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a142346a98b4598b6c393ef50456a26 2023-09-19 19:03:39,749 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/.tmp/info/a15ed85cdca547d59499db6ad6066c94 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/info/a15ed85cdca547d59499db6ad6066c94 2023-09-19 19:03:39,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a15ed85cdca547d59499db6ad6066c94 2023-09-19 19:03:39,755 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/info/a15ed85cdca547d59499db6ad6066c94, entries=48, sequenceid=131, filesize=10.3 K 2023-09-19 19:03:39,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/.tmp/rep_barrier/97bcee2af6e54ab2aff6e2e950ea0a2d as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/rep_barrier/97bcee2af6e54ab2aff6e2e950ea0a2d 2023-09-19 19:03:39,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 97bcee2af6e54ab2aff6e2e950ea0a2d 2023-09-19 19:03:39,760 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/rep_barrier/97bcee2af6e54ab2aff6e2e950ea0a2d, entries=13, sequenceid=131, filesize=6.4 K 2023-09-19 19:03:39,761 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/.tmp/table/0a142346a98b4598b6c393ef50456a26 as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/table/0a142346a98b4598b6c393ef50456a26 2023-09-19 19:03:39,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0a142346a98b4598b6c393ef50456a26 2023-09-19 19:03:39,766 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/table/0a142346a98b4598b6c393ef50456a26, entries=24, sequenceid=131, filesize=6.9 K 2023-09-19 19:03:39,767 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 107ms, sequenceid=131, compaction requested=false 2023-09-19 19:03:39,777 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-19 19:03:39,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-19 19:03:39,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-19 19:03:39,778 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-19 19:03:39,778 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-19 19:03:39,779 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-19 19:03:39,804 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:39,804 INFO [RS:2;jenkins-hbase4:42277] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42277,1695150075159; zookeeper connection closed. 2023-09-19 19:03:39,804 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:42277-0x100c5909b960003, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:39,804 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6d21e355] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6d21e355 2023-09-19 19:03:39,861 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39869,1695150075115; all regions closed. 2023-09-19 19:03:39,861 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43479,1695150075067; all regions closed. 2023-09-19 19:03:39,869 DEBUG [RS:1;jenkins-hbase4:39869] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs 2023-09-19 19:03:39,869 INFO [RS:1;jenkins-hbase4:39869] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39869%2C1695150075115:(num 1695150076815) 2023-09-19 19:03:39,869 DEBUG [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs 2023-09-19 19:03:39,869 DEBUG [RS:1;jenkins-hbase4:39869] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,869 INFO [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43479%2C1695150075067.meta:.meta(num 1695150076990) 2023-09-19 19:03:39,869 INFO [RS:1;jenkins-hbase4:39869] regionserver.LeaseManager(133): Closed leases 2023-09-19 19:03:39,870 INFO [RS:1;jenkins-hbase4:39869] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-19 19:03:39,870 INFO [RS:1;jenkins-hbase4:39869] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-19 19:03:39,870 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 19:03:39,870 INFO [RS:1;jenkins-hbase4:39869] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-19 19:03:39,870 INFO [RS:1;jenkins-hbase4:39869] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-19 19:03:39,871 INFO [RS:1;jenkins-hbase4:39869] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39869 2023-09-19 19:03:39,874 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:03:39,874 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:03:39,874 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39869,1695150075115 2023-09-19 19:03:39,875 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39869,1695150075115] 2023-09-19 19:03:39,875 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39869,1695150075115; numProcessing=2 2023-09-19 19:03:39,877 DEBUG [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/oldWALs 2023-09-19 19:03:39,877 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39869,1695150075115 already deleted, retry=false 2023-09-19 19:03:39,877 INFO [RS:0;jenkins-hbase4:43479] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43479%2C1695150075067:(num 1695150076814) 2023-09-19 19:03:39,877 DEBUG [RS:0;jenkins-hbase4:43479] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,877 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39869,1695150075115 expired; onlineServers=1 2023-09-19 19:03:39,877 INFO [RS:0;jenkins-hbase4:43479] regionserver.LeaseManager(133): Closed leases 2023-09-19 19:03:39,877 INFO [RS:0;jenkins-hbase4:43479] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-19 19:03:39,877 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 19:03:39,878 INFO [RS:0;jenkins-hbase4:43479] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43479 2023-09-19 19:03:39,881 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43479,1695150075067 2023-09-19 19:03:39,881 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-19 19:03:39,882 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43479,1695150075067] 2023-09-19 19:03:39,882 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43479,1695150075067; numProcessing=3 2023-09-19 19:03:39,883 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43479,1695150075067 already deleted, retry=false 2023-09-19 19:03:39,883 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43479,1695150075067 expired; onlineServers=0 2023-09-19 19:03:39,883 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33343,1695150073780' ***** 2023-09-19 19:03:39,883 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-19 19:03:39,884 DEBUG [M:0;jenkins-hbase4:33343] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78a77df4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-19 19:03:39,884 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33343,1695150073780 2023-09-19 19:03:39,884 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33343,1695150073780; all regions closed. 2023-09-19 19:03:39,884 DEBUG [M:0;jenkins-hbase4:33343] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-19 19:03:39,884 DEBUG [M:0;jenkins-hbase4:33343] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-19 19:03:39,884 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-19 19:03:39,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695150076441] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695150076441,5,FailOnTimeoutGroup] 2023-09-19 19:03:39,884 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695150076441] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695150076441,5,FailOnTimeoutGroup] 2023-09-19 19:03:39,884 DEBUG [M:0;jenkins-hbase4:33343] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-19 19:03:39,884 INFO [M:0;jenkins-hbase4:33343] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-19 19:03:39,884 INFO [M:0;jenkins-hbase4:33343] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-19 19:03:39,884 INFO [M:0;jenkins-hbase4:33343] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-19 19:03:39,884 DEBUG [M:0;jenkins-hbase4:33343] master.HMaster(1512): Stopping service threads 2023-09-19 19:03:39,885 INFO [M:0;jenkins-hbase4:33343] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-19 19:03:39,885 ERROR [M:0;jenkins-hbase4:33343] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-13,5,PEWorkerGroup] 2023-09-19 19:03:39,885 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-19 19:03:39,885 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-19 19:03:39,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-19 19:03:39,885 INFO [M:0;jenkins-hbase4:33343] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-19 19:03:39,886 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-19 19:03:39,886 DEBUG [M:0;jenkins-hbase4:33343] zookeeper.ZKUtil(398): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-19 19:03:39,886 WARN [M:0;jenkins-hbase4:33343] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-19 19:03:39,886 INFO [M:0;jenkins-hbase4:33343] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-19 19:03:39,886 INFO [M:0;jenkins-hbase4:33343] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-19 19:03:39,887 DEBUG [M:0;jenkins-hbase4:33343] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-19 19:03:39,887 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:03:39,887 DEBUG [M:0;jenkins-hbase4:33343] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:03:39,887 DEBUG [M:0;jenkins-hbase4:33343] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-19 19:03:39,887 DEBUG [M:0;jenkins-hbase4:33343] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:03:39,887 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.91 KB heapSize=452.14 KB 2023-09-19 19:03:39,899 INFO [M:0;jenkins-hbase4:33343] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.91 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c9d20ad58d34cceba219c63d596dafb 2023-09-19 19:03:39,903 INFO [M:0;jenkins-hbase4:33343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c9d20ad58d34cceba219c63d596dafb 2023-09-19 19:03:39,904 DEBUG [M:0;jenkins-hbase4:33343] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c9d20ad58d34cceba219c63d596dafb as hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c9d20ad58d34cceba219c63d596dafb 2023-09-19 19:03:39,907 INFO [M:0;jenkins-hbase4:33343] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c9d20ad58d34cceba219c63d596dafb 2023-09-19 19:03:39,907 INFO [M:0;jenkins-hbase4:33343] regionserver.HStore(1080): Added hdfs://localhost:37439/user/jenkins/test-data/103f65ef-c6a3-7f6b-90aa-bf102f9eff37/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c9d20ad58d34cceba219c63d596dafb, entries=119, sequenceid=899, filesize=28.7 K 2023-09-19 19:03:39,908 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegion(2948): Finished flush of dataSize ~375.91 KB/384931, heapSize ~452.13 KB/462976, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 21ms, sequenceid=899, compaction requested=false 2023-09-19 19:03:39,910 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-19 19:03:39,910 DEBUG [M:0;jenkins-hbase4:33343] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-19 19:03:39,914 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-19 19:03:39,914 INFO [M:0;jenkins-hbase4:33343] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-19 19:03:39,915 INFO [M:0;jenkins-hbase4:33343] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33343 2023-09-19 19:03:39,918 DEBUG [M:0;jenkins-hbase4:33343] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,33343,1695150073780 already deleted, retry=false 2023-09-19 19:03:39,976 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:39,976 INFO [RS:1;jenkins-hbase4:39869] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39869,1695150075115; zookeeper connection closed. 2023-09-19 19:03:39,976 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:39869-0x100c5909b960002, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:39,977 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@40263408] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@40263408 2023-09-19 19:03:40,076 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:40,076 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): master:33343-0x100c5909b960000, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:40,076 INFO [M:0;jenkins-hbase4:33343] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33343,1695150073780; zookeeper connection closed. 2023-09-19 19:03:40,177 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:40,177 INFO [RS:0;jenkins-hbase4:43479] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43479,1695150075067; zookeeper connection closed. 2023-09-19 19:03:40,177 DEBUG [Listener at localhost/35845-EventThread] zookeeper.ZKWatcher(600): regionserver:43479-0x100c5909b960001, quorum=127.0.0.1:56787, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-19 19:03:40,177 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@67c2b18] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@67c2b18 2023-09-19 19:03:40,177 INFO [Listener at jenkins-hbase4.apache.org/34965] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-19 19:03:40,178 WARN [Listener at jenkins-hbase4.apache.org/34965] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 19:03:40,182 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 19:03:40,286 WARN [BP-1423331782-172.31.14.131-1695150070084 heartbeating to localhost/127.0.0.1:37439] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 19:03:40,286 WARN [BP-1423331782-172.31.14.131-1695150070084 heartbeating to localhost/127.0.0.1:37439] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1423331782-172.31.14.131-1695150070084 (Datanode Uuid d9b60c53-3990-4b29-be7e-5c8ffc02819c) service to localhost/127.0.0.1:37439 2023-09-19 19:03:40,288 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data5/current/BP-1423331782-172.31.14.131-1695150070084] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 19:03:40,288 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data6/current/BP-1423331782-172.31.14.131-1695150070084] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 19:03:40,290 WARN [Listener at jenkins-hbase4.apache.org/34965] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 19:03:40,292 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 19:03:40,394 WARN [BP-1423331782-172.31.14.131-1695150070084 heartbeating to localhost/127.0.0.1:37439] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 19:03:40,394 WARN [BP-1423331782-172.31.14.131-1695150070084 heartbeating to localhost/127.0.0.1:37439] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1423331782-172.31.14.131-1695150070084 (Datanode Uuid 3b395402-8293-4090-902a-b51910be1780) service to localhost/127.0.0.1:37439 2023-09-19 19:03:40,395 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data3/current/BP-1423331782-172.31.14.131-1695150070084] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 19:03:40,395 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data4/current/BP-1423331782-172.31.14.131-1695150070084] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 19:03:40,396 WARN [Listener at jenkins-hbase4.apache.org/34965] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-19 19:03:40,398 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 19:03:40,502 WARN [BP-1423331782-172.31.14.131-1695150070084 heartbeating to localhost/127.0.0.1:37439] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-19 19:03:40,502 WARN [BP-1423331782-172.31.14.131-1695150070084 heartbeating to localhost/127.0.0.1:37439] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1423331782-172.31.14.131-1695150070084 (Datanode Uuid 6d627659-1c4c-4008-8749-ad214a8d1d6b) service to localhost/127.0.0.1:37439 2023-09-19 19:03:40,502 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data1/current/BP-1423331782-172.31.14.131-1695150070084] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 19:03:40,503 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/86892e92-1886-dfdd-5af8-6a2e0fe9dfd3/cluster_17b8110f-2b3d-c5aa-4b85-05ed9ff5df0a/dfs/data/data2/current/BP-1423331782-172.31.14.131-1695150070084] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-19 19:03:40,524 INFO [Listener at jenkins-hbase4.apache.org/34965] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-19 19:03:40,651 INFO [Listener at jenkins-hbase4.apache.org/34965] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-19 19:03:40,740 INFO [Listener at jenkins-hbase4.apache.org/34965] hbase.HBaseTestingUtility(1293): Minicluster is down